-- Logs begin at Fri 2022-09-09 10:50:17 UTC, end at Fri 2022-09-09 12:05:28 UTC. -- Sep 09 11:23:56.979797 dv-cinder-856460-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 11:23:56.988834 dv-cinder-856460-2-smb devstack@keystone.service[81584]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 11:23:56 2022] *** Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: nodename: dv-cinder-856460-2-smb Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: machine: x86_64 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: clock source: unix Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: pcre jit disabled Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: detected number of CPU cores: 4 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: current working directory: / Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: detected binary path: /usr/bin/uwsgi-core Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: your processes number limit is 47680 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: your memory page size is 4096 bytes Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: detected max file descriptor number: 2048 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: lock engine: pthread robust mutexes Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: thunder lock: enabled Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 11:23:56.992520 dv-cinder-856460-2-smb devstack@keystone.service[81584]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 11:23:57.030830 dv-cinder-856460-2-smb devstack@keystone.service[81584]: Python main interpreter initialized at 0x556484b889c0 Sep 09 11:23:57.030830 dv-cinder-856460-2-smb devstack@keystone.service[81584]: python threads support enabled Sep 09 11:23:57.030830 dv-cinder-856460-2-smb devstack@keystone.service[81584]: your server socket listen backlog is limited to 100 connections Sep 09 11:23:57.030830 dv-cinder-856460-2-smb devstack@keystone.service[81584]: your mercy for graceful operations on workers is 90 seconds Sep 09 11:23:57.031188 dv-cinder-856460-2-smb devstack@keystone.service[81584]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 11:23:57.031264 dv-cinder-856460-2-smb devstack@keystone.service[81584]: *** Operational MODE: preforking *** Sep 09 11:23:57.031519 dv-cinder-856460-2-smb devstack@keystone.service[81584]: *** uWSGI is running in multiple interpreter mode *** Sep 09 11:23:57.031519 dv-cinder-856460-2-smb devstack@keystone.service[81584]: spawned uWSGI master process (pid: 81584) Sep 09 11:23:57.031715 dv-cinder-856460-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 11:23:57.032714 dv-cinder-856460-2-smb devstack@keystone.service[81584]: spawned uWSGI worker 1 (pid: 81595, cores: 1) Sep 09 11:23:57.032714 dv-cinder-856460-2-smb devstack@keystone.service[81584]: spawned uWSGI worker 2 (pid: 81596, cores: 1) Sep 09 11:23:57.032714 dv-cinder-856460-2-smb devstack@keystone.service[81584]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 11:24:01.313782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:24:01.313782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: from cryptography.utils import int_from_bytes Sep 09 11:24:01.314597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:24:01.314597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: from cryptography.utils import int_from_bytes Sep 09 11:24:01.316604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:24:01.316604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: from cryptography.utils import int_from_bytes Sep 09 11:24:01.317083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:24:01.317083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: from cryptography.utils import int_from_bytes Sep 09 11:24:01.367709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:24:01.367898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:24:01.368627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] command line args: [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:24:01.369118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:24:01.369421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:24:01.369531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ================================================================================ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:24:01.369609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:24:01.369688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] admin_token = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.369796 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] command line args: [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:24:01.369916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] config_dir = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:24:01.370169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ================================================================================ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:24:01.370328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] config_source = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] debug = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] admin_token = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_dir = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.370933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_source = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] debug = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.371981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_config_append = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_dir = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_config_append = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.372983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_dir = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.373862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.374971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.375965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.376084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.376313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.376451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.376531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] publish_errors = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.376721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.376833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] publish_errors = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.377965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] standard_threads = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] standard_threads = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] use_journal = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] use_json = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.378919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] use_stderr = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_journal = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] use_syslog = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_json = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_stderr = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_syslog = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.379695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:24:01.379773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.379929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.380983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.381945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.382928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.383038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.383128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.383270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.383357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.383509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.383638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.384350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.384479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.384627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.384878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.384970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.385258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.391807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.391807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.391943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.392993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.393972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.394995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.395986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.396971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.397972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.398930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.399904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.400933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.401940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.402996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.403974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.404954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.405678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.406999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.external = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.external = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.407937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.password = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.token = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.password = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.token = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.408911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.409968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.410892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411580 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.411957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.412984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.413960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.414953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.415992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.416908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.417870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.422562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.422720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.422720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.422891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.422891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.423932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.424995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.425997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.426929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.427940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.428989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.429969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.430051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.430129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.430203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.430277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.430352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.430931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.431932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.432966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.433957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.434909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.435892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.436921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.437903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.438988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] role.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.439923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] role.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.440965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.441098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.441182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.441288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.441366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.445549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.445758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.445848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.445925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.446886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.447925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.448994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.449973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.450939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.451939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.452947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.453994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.454953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:24:01.455157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.455157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.455157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.455383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.455512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.455751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.455990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:24:01.456159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:24:01.484386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.484605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.484822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.485578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.487349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.487349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.493681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.495282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.522272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.527818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.527910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.527910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.593539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.594410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.656880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.657097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.657617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.657852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.820216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.820451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.820669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.820884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.821145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.821381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.822261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.822563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.822833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.823079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.823296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.823505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.849557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.849669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.849805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.849892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.850966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.851186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.867709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.868585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.880708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.880939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.881978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.882104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.882192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.882380 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.882591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:24:01.899628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.899830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:24:01.900187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.900292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.900388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:24:01.900467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:24:01.900624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.900716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.900877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.900963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:24:01.901130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.901240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.901406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.901494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.901685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.901940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.910873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.924857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.925202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.925301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.925301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.925575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.925955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.926713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.947684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.948444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.949131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.949434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.949923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.950206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.954081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.954360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.954638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.955049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.955331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.955609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.960906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.961190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.962548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.962902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.967309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.967602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.967888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.968169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.968439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.968570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.968707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.968864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.968973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.969148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.969257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.969457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.976122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.976122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.976122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.976122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.984657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.984928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.986277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.986554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.988761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.990431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.992018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.992311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.994594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.994905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:01.997115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:01.999149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.000243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.002329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.003461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.003755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.004035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.010754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.020895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.021179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.021471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.021730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.023204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.023486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.023753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.024013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.029516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.031039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.031572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.032556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.032829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.033102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.034684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.034959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.035569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.035848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.036125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.036421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.036798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.037698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.037987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.038273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.038563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.038944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.048275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.048556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.048835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.049112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.049510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.049787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.050073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.050303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.050585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.050864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.051142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.051515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.051803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.052077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.066202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.069078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.070734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.072867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.074230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.074320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.075750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.076029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.076431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.077290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.078735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.080239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.080519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.080912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.082776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.084240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.087524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.087710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.087963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.088248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.088524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.088994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.092146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.092546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.092829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.093192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.102255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.102255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.102255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.102841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.103133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.103410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.108816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.109098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.109414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.109688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.109957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.110226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.110361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:24:02.110503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.110644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.110804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.110935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.111899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.112036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.112194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.112339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.112567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.112709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.112918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.113052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.113182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.113409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.113683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:24:02.149063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556484b889c0 pid: 81596 (default app) Sep 09 11:24:02.150786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556484b889c0 pid: 81595 (default app) Sep 09 11:24:02.152562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ee82b-6308-45c9-be22-ea8920ff2991 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:02.152846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ee82b-6308-45c9-be22-ea8920ff2991 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:02.153116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ee82b-6308-45c9-be22-ea8920ff2991 None None] PATH_INFO: `/v3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:02.157291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Fri Sep 9 11:24:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:09.951338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:09.951895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:09.951895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:09.956221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:09.961735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:09.962276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:09.962276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:10.033720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: INFO dbcounter [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] Registered counter for database keystone Sep 09 11:24:10.055873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG oslo_db.sqlalchemy.engines [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:24:10.062138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writer thread running {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:24:10.243387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG passlib.handlers.bcrypt [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81596) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:24:10.243685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG passlib.handlers.bcrypt [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81596) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:24:10.301971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:10.303555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:10.435158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:24:10.726153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:10.811589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: INFO dbcounter [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] Registered counter for database keystone Sep 09 11:24:10.831023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG oslo_db.sqlalchemy.engines [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:24:10.837333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writer thread running {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:24:10.957107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699ce63-1588-4122-8c38-f327b9cb2c18 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:10.962160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:10.962781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:10.963055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:10.963319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:10.971476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:11.024591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:24:11.024927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10859b1f-a90e-436e-a7d5-cc8a4c6ef8b5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:11.034204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Fri Sep 9 11:24:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:24:11.040650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:11.057919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02cf5e-dd9d-4a4a-9731-302cab42d0d6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:11.062212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:11.063318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:11.063594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:11.063855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] PATH_INFO: `/v3/projects/ff309e01cdfe4cb7b8cf92847353f141` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:11.065457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff309e01cdfe4cb7b8cf92847353f141)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:11.119915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING keystone.common.rbac_enforcer.enforcer [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:24:11.120290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96953a8d-477f-4f25-a114-626064d5fb50 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:11.125556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Fri Sep 9 11:24:11 2022] GET /identity/v3/projects/ff309e01cdfe4cb7b8cf92847353f141 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:13.315051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c6b10-73a3-47eb-a276-4a9ab0d062ed None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:13.315592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c6b10-73a3-47eb-a276-4a9ab0d062ed None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:13.315592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c6b10-73a3-47eb-a276-4a9ab0d062ed None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:13.320773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:13.326167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:13.326605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:13.326702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:13.346327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:13.347849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:13.355657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:24:13.630247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c6b10-73a3-47eb-a276-4a9ab0d062ed None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:13.642971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c6b10-73a3-47eb-a276-4a9ab0d062ed None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:13.647790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e48cd-cb89-4fcc-88fc-d94fc4e96c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:13.648386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e48cd-cb89-4fcc-88fc-d94fc4e96c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:13.648664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e48cd-cb89-4fcc-88fc-d94fc4e96c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:13.648933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e48cd-cb89-4fcc-88fc-d94fc4e96c9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:13.656476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e48cd-cb89-4fcc-88fc-d94fc4e96c9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:13.658290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e48cd-cb89-4fcc-88fc-d94fc4e96c9a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:13.667828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Fri Sep 9 11:24:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:24:13.673004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:13.682888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b54370-8dcb-4763-a91c-806053411a92 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:13.687174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191afbc0-643b-46ac-93b7-517826f33fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:13.687787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191afbc0-643b-46ac-93b7-517826f33fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:13.688061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191afbc0-643b-46ac-93b7-517826f33fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:13.688328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191afbc0-643b-46ac-93b7-517826f33fa3 admin admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:13.689654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191afbc0-643b-46ac-93b7-517826f33fa3 admin admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:13.691469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191afbc0-643b-46ac-93b7-517826f33fa3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:13.692992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Fri Sep 9 11:24:13 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:15.917779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1a57e-ecf5-43a9-b266-068d31082436 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:15.918280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1a57e-ecf5-43a9-b266-068d31082436 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:15.918280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1a57e-ecf5-43a9-b266-068d31082436 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:15.919701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:15.924924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:15.925392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:15.925512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:15.929164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7542d2-b789-431d-8802-54636c13081c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:15.929488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7542d2-b789-431d-8802-54636c13081c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:15.929763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7542d2-b789-431d-8802-54636c13081c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:15.931003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:15.936047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:15.936321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:15.936587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:15.944172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:15.945387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:15.979185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG passlib.handlers.bcrypt [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81595) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:24:15.979564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG passlib.handlers.bcrypt [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81595) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:24:16.026044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:16.029152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:16.030783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:16.128100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:16.294502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.318171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:16.397527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.398958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b77f0-a94d-4476-8fb3-398726ea9398 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.433051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:16.433694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:16.433968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:16.434234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:16.445579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:16.454240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:16.455276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:16.456120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:16.461318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.500065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96cdbb-ec99-46ce-8ac9-dad68067e6a2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.502331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:16.536069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:16.537571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:16.537899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:16.538162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:16.546860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:16.566351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6431b08-3b1f-40e6-9daa-b8b3cacc19fb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.601794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:16.602412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:16.602685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:16.602951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:16.603601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:16.603893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:16.605304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:16.606645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:16.608150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:16.618466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:16.624086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.706812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:16.712657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.715348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:16.721560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7af15-795e-4519-b4f6-00abe11c5e87 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.755957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:16.756439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:16.756720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:16.756989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:16.758145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:16.759659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:16.761230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:16.768888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.785715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:16.809791 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c071-abb6-423b-9e51-909aefbfb591 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.843334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:16.844177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:16.844455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:16.844725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:16.863889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:16.866224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:16.870910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58450-6a28-4d94-88b6-01805f4caec6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:24:16.884164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:16.885078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:24:16.885932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:24:16.885932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:24:16.885932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:16.885932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:16.891071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.906983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:16.907605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:16.907876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:16.908140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:16.909268 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:16.910722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:16.912298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:16.918003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:16.951564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:16.996833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e352c-ba9a-4be6-b77b-982cf0ce0a70 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:16.998158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:17.018649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd9a1-9cce-4855-9675-da583fe466ab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:17.030676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:17.031277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:17.031553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:17.031819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:17.032453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:17.032750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:17.034144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59790e0-9702-46ca-9a67-2db6d84f6fc1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:17.050946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 10/20] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:17.052051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:17.053127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:17.053424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:17.053693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:17.054405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.domain.id=default, user.id=370ac9ef52ea4ad6930fdc193054ac74) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:17.054703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:17.056156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109ec9c-d968-457c-9612-f7949a3c03c2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:17.063797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 11/21] 10.222.0.64 () {56 vars in 1322 bytes} [Fri Sep 9 11:24:16 2022] GET /identity/v3/role_assignments?user.id=370ac9ef52ea4ad6930fdc193054ac74&scope.domain.id=default&role.id=137cd8e0839747668eef67677a0171b5 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:19.526093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc68d60-46a6-48ea-9f03-580801676c7b None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:19.526637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc68d60-46a6-48ea-9f03-580801676c7b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:19.526637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc68d60-46a6-48ea-9f03-580801676c7b None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:19.528019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 11/22] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:19.533854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c09ac-c78a-4cda-830f-4e9c446ebf13 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:19.534345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c09ac-c78a-4cda-830f-4e9c446ebf13 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:19.534417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c09ac-c78a-4cda-830f-4e9c446ebf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:19.562186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a60c09ac-c78a-4cda-830f-4e9c446ebf13 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:19.563480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a60c09ac-c78a-4cda-830f-4e9c446ebf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:19.638350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753f61-33a9-4cd0-b961-e0f0723ebfdc None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:19.638639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753f61-33a9-4cd0-b961-e0f0723ebfdc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:19.638901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753f61-33a9-4cd0-b961-e0f0723ebfdc None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:19.640242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 12/23] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:19.646571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749783bf-b399-4b7d-bef9-bcb9112dbf06 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:19.646856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749783bf-b399-4b7d-bef9-bcb9112dbf06 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:19.647127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749783bf-b399-4b7d-bef9-bcb9112dbf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:19.652873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:19.670608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-749783bf-b399-4b7d-bef9-bcb9112dbf06 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:19.671833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-749783bf-b399-4b7d-bef9-bcb9112dbf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:19.760940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:19.978546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca377-b749-4249-a4a0-1083ae49b1e6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:19.980573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca377-b749-4249-a4a0-1083ae49b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:19.980573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca377-b749-4249-a4a0-1083ae49b1e6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:19.980747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 13/26] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:19.986190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:19.986720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:19.987194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.011619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:20.013177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:20.032041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca377-b749-4249-a4a0-1083ae49b1e6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.097727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:20.143148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 14/27] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:20.151569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:20.189092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca377-b749-4249-a4a0-1083ae49b1e6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.223934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.261011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.261632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.261919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.262189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.275942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:20.280977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:20.281851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:20.282607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 14/28] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:20.288752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.390081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e70b8-5f26-44b1-8cb9-e2f1fa988994 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.450072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9df7-ac9c-4fda-8af4-3d8d858a8250 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.461943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.462582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.462864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.463136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.479974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:20.482433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:20.499406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.500007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.500286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.500610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.501492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:20.502008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:20.503562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:24:20.503678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:20.504751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:24:20.505734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:24:20.505734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:24:20.505734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:20.513745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 15/29] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:20.514682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 15/30] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:20.514932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:20.520813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.522190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.587974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:20.714335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8bd2d-9c37-4b6a-b076-c1daeacb1c6e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.731190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8683c9-60e2-440c-8073-9aefcaa06bda None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.761992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.763323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.763601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.763926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.764525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:20.764823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:20.766255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161e349-1236-4892-9586-3392aceb8729 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:20.774377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.775247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.775750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.776215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.777565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:20.779310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:20.781109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 16/31] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:20 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:20.782062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.788045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 16/32] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:20.790190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ffd7-5818-4400-99b2-210455f2d6a2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.790488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ffd7-5818-4400-99b2-210455f2d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.790763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ffd7-5818-4400-99b2-210455f2d6a2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.792050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 17/33] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:20.797593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984ffd7-5818-4400-99b2-210455f2d6a2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:20.869024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:20.911313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:20.924485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8b004-615b-4e56-b786-b37b7d677369 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.924959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984ffd7-5818-4400-99b2-210455f2d6a2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:20.964374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106d879-5f9d-40dd-967b-e805126e7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.965292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106d879-5f9d-40dd-967b-e805126e7b44 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.965732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106d879-5f9d-40dd-967b-e805126e7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.966235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106d879-5f9d-40dd-967b-e805126e7b44 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.967319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106d879-5f9d-40dd-967b-e805126e7b44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:20.967856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:20.968551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:20.968932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:20.969330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:20.969714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106d879-5f9d-40dd-967b-e805126e7b44 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:20.970188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:20.971652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:21.182512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 17/34] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Sep 9 11:24:20 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:21.183625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:21.194660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 18/35] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:24:20 2022] POST /identity/v3/projects => generated 301 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:21.196658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6ba58-62d9-47b1-86d2-dc13506937fc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.197162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6ba58-62d9-47b1-86d2-dc13506937fc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.197668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6ba58-62d9-47b1-86d2-dc13506937fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.219144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-44f6ba58-62d9-47b1-86d2-dc13506937fc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:21.221329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-44f6ba58-62d9-47b1-86d2-dc13506937fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:21.314103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 19/36] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:21.325604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2b280-b8e6-42c4-82da-a9b566553ce5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.325935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2b280-b8e6-42c4-82da-a9b566553ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.326170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2b280-b8e6-42c4-82da-a9b566553ce5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.327996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 20/37] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:21.329994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf45f0-4e6c-462a-9b84-9c3e7f4fa88c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:21.339479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279359e-5d17-407f-b3b3-a82e2975d95e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.339794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279359e-5d17-407f-b3b3-a82e2975d95e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.340045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279359e-5d17-407f-b3b3-a82e2975d95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.382505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8279359e-5d17-407f-b3b3-a82e2975d95e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:21.383811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8279359e-5d17-407f-b3b3-a82e2975d95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:21.388615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:21.408577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:21.415977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.415977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.415977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.418600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:21.420959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:21.426020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 18/38] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:21.433839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:21.499817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:21.507502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 21/39] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:21.578703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b18d-94b7-4b7b-8a8c-ba8db5bbc35d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.579088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b18d-94b7-4b7b-8a8c-ba8db5bbc35d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.579371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b18d-94b7-4b7b-8a8c-ba8db5bbc35d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.581017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 22/40] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:21.583680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784a0a-0cf1-481d-8194-cb00f2e35943 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:21.588191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.588679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.588766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.616716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:21.618205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:21.636386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:21.637055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.637427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.637758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] PATH_INFO: `/v3/domains/default/users/370ac9ef52ea4ad6930fdc193054ac74/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.639865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=370ac9ef52ea4ad6930fdc193054ac74, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:21.641372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:21.704396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 23/41] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:21.741410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:21.749690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 19/42] 10.222.0.64 () {58 vars in 1361 bytes} [Fri Sep 9 11:24:21 2022] PUT /identity/v3/domains/default/users/370ac9ef52ea4ad6930fdc193054ac74/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:21.806398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:21.866033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e749d2-564a-4f9e-800a-b07d904dae61 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:21.885371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:21.903859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:21.911362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:21.912373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.912822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.913294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.914184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:21.915899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:21.949891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f93717-a9a5-4e8d-85fb-21270abaef21 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:21.990714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:21.991251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:21.991531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:21.991805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:21.992480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:21.993905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:22.049967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 24/43] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Sep 9 11:24:21 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:24:22.051148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:22.087861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 20/44] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Sep 9 11:24:21 2022] POST /identity/v3/roles => generated 223 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:24:22.196156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06181-129a-4a26-a78f-bee05bab8a84 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:22.242157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a016122-b1a4-479a-819c-65030aa18370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:22.242738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a016122-b1a4-479a-819c-65030aa18370 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:22.243016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a016122-b1a4-479a-819c-65030aa18370 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:22.243290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a016122-b1a4-479a-819c-65030aa18370 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:22.246050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a016122-b1a4-479a-819c-65030aa18370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:22.247572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a016122-b1a4-479a-819c-65030aa18370 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:22.249291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 25/45] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:22.258392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:22.496843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a837c92-bdf7-4b7a-9754-b0e5e46cd9bb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:22.510754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:22.532560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d72241-cb61-42bc-b62b-a8dce96d294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:22.533168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72241-cb61-42bc-b62b-a8dce96d294a None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:22.533474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72241-cb61-42bc-b62b-a8dce96d294a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:22.533743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72241-cb61-42bc-b62b-a8dce96d294a None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:22.534380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d72241-cb61-42bc-b62b-a8dce96d294a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:22.536480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d72241-cb61-42bc-b62b-a8dce96d294a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:22.681035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 21/46] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:24:22 2022] POST /identity/v3/projects => generated 312 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:24.106860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896fbc7-3463-4baa-a090-0f3f6af04386 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.107384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896fbc7-3463-4baa-a090-0f3f6af04386 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.107384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896fbc7-3463-4baa-a090-0f3f6af04386 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.108739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 26/47] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:24.114098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.114664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.114664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.132985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:24.134531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:24.199452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:24.463603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896fbc7-3463-4baa-a090-0f3f6af04386 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:24.522449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:24.564279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896fbc7-3463-4baa-a090-0f3f6af04386 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:24.597768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:24.598599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.598880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.599222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.611229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:24.617925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:24.618985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:24.620027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 27/49] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:24.624797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:24.715345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:24.722027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa86b4-8b22-49e1-9998-6c31e045a1f1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:24.757203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:24.757855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.758188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.758456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.759140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:24.759439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:24.760882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7d76c-8f96-4cf5-bd70-aec1b145b229 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:24.770879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 23/50] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:24.777052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:24.871399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bec92-8732-4960-88c5-08c7f42874a1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.871810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bec92-8732-4960-88c5-08c7f42874a1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.872107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bec92-8732-4960-88c5-08c7f42874a1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.873656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 24/51] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:24.876564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f41b-d8d6-437b-91fc-8560530846c2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:24.878510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.878804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.879088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.893873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:24.897526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:24.898740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:24.914045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:24.914681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:24.914966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:24.915241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:24.916640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:24.918138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:24.919731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 28/52] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:24 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:24.925309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:24.971006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 25/53] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:25.043204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b3f1-2451-4550-aa30-1dc492bbf6d3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:25.076079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:25.076695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:25.076978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:25.077284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:25.078404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:25.079853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:25.081450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 29/54] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:25.087417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:25.172252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:25.186478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadb41f-9d5a-4299-a41e-79ac748807d6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:25.220320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:25.220915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:25.221261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:25.221491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:25.222209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.domain.id=default, user.id=370ac9ef52ea4ad6930fdc193054ac74) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:25.222513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:25.224694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:25.230390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 26/55] 10.222.0.64 () {56 vars in 1322 bytes} [Fri Sep 9 11:24:25 2022] GET /identity/v3/role_assignments?user.id=370ac9ef52ea4ad6930fdc193054ac74&scope.domain.id=default&role.id=137cd8e0839747668eef67677a0171b5 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:25.244064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:25.427524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:25.475685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4e56-bbb2-4d46-926d-8c33e0a02738 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:25.510161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654fb6-f1d7-4fb5-ae84-466384df148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:25.510793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654fb6-f1d7-4fb5-ae84-466384df148f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:25.511075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654fb6-f1d7-4fb5-ae84-466384df148f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:25.511347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654fb6-f1d7-4fb5-ae84-466384df148f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:25.512430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654fb6-f1d7-4fb5-ae84-466384df148f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:25.513909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654fb6-f1d7-4fb5-ae84-466384df148f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:25.515462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 30/56] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:25.521994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:25.622629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3c72a-a0a5-40cf-a659-3bf3e40eff8b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:25.657562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498608d9-8914-471e-95d7-e2952d4b9c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:25.658154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498608d9-8914-471e-95d7-e2952d4b9c1b None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:25.658427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498608d9-8914-471e-95d7-e2952d4b9c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:25.658692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498608d9-8914-471e-95d7-e2952d4b9c1b None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:25.659330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498608d9-8914-471e-95d7-e2952d4b9c1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:25.660980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498608d9-8914-471e-95d7-e2952d4b9c1b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:25.745112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 27/57] 10.222.0.64 () {60 vars in 1140 bytes} [Fri Sep 9 11:24:25 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:27.922556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339b7c-883f-4eeb-b412-a79fb2a918c3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:27.923053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339b7c-883f-4eeb-b412-a79fb2a918c3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:27.923053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339b7c-883f-4eeb-b412-a79fb2a918c3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:27.924371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 31/58] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:27.930347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:27.930720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:27.930895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:27.937160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:27.949452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:27.950647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:28.016201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 28/59] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:28.293336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339b7c-883f-4eeb-b412-a79fb2a918c3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:28.390402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339b7c-883f-4eeb-b412-a79fb2a918c3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:28.413023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:28.423989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228eb0ad-88bc-4b20-904b-a131bfa4fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:28.424611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eb0ad-88bc-4b20-904b-a131bfa4fff5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:28.424888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eb0ad-88bc-4b20-904b-a131bfa4fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:28.425201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eb0ad-88bc-4b20-904b-a131bfa4fff5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:28.432312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eb0ad-88bc-4b20-904b-a131bfa4fff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:28.432312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eb0ad-88bc-4b20-904b-a131bfa4fff5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:28.432312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 32/60] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:28.434801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:28.529101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930414-10b3-480f-8be6-a9b64ea1fba4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:28.557566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:28.562106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e24d7f-3f4d-44e0-a048-ce2f70a0cb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:28.562699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24d7f-3f4d-44e0-a048-ce2f70a0cb6d None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:28.562976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24d7f-3f4d-44e0-a048-ce2f70a0cb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:28.563245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e24d7f-3f4d-44e0-a048-ce2f70a0cb6d None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:28.563877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e24d7f-3f4d-44e0-a048-ce2f70a0cb6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:28.565340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e24d7f-3f4d-44e0-a048-ce2f70a0cb6d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:28.677442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 29/61] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:24:28 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:31.974189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb826-1ed1-4c4d-bc0b-b86cbcfcfc1e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:31.974701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb826-1ed1-4c4d-bc0b-b86cbcfcfc1e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:31.974774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb826-1ed1-4c4d-bc0b-b86cbcfcfc1e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:31.976348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 33/62] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:31.981835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9920d-aac5-4757-8b92-64eed179725f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:31.982243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9920d-aac5-4757-8b92-64eed179725f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:31.982407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9920d-aac5-4757-8b92-64eed179725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.007495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8fd9920d-aac5-4757-8b92-64eed179725f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:32.008698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8fd9920d-aac5-4757-8b92-64eed179725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:32.112795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 30/63] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:32.161266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f305-877f-409c-af5c-95c393b23c09 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.161266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f305-877f-409c-af5c-95c393b23c09 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.161266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f305-877f-409c-af5c-95c393b23c09 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.162210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 34/64] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:32.167984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d401-4dd5-4dd4-8c1e-affd3c18fdca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.168274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d401-4dd5-4dd4-8c1e-affd3c18fdca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.168551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d401-4dd5-4dd4-8c1e-affd3c18fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.193726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-51e0d401-4dd5-4dd4-8c1e-affd3c18fdca None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:32.194906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51e0d401-4dd5-4dd4-8c1e-affd3c18fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:32.229325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62016-f281-4323-bab6-8668f471e420 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.229325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62016-f281-4323-bab6-8668f471e420 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.229325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62016-f281-4323-bab6-8668f471e420 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.230175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 35/65] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:32.235109 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da24e4-f737-43d2-875f-9903acefcf1e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.235606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da24e4-f737-43d2-875f-9903acefcf1e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.236089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da24e4-f737-43d2-875f-9903acefcf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.256541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-17da24e4-f737-43d2-875f-9903acefcf1e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:32.258114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-17da24e4-f737-43d2-875f-9903acefcf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:32.312121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 31/66] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:32.357667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 36/67] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:32.436635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22e27b-2a77-4ea1-aa50-c1e99c84df06 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.436917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22e27b-2a77-4ea1-aa50-c1e99c84df06 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.437424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22e27b-2a77-4ea1-aa50-c1e99c84df06 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.438958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 32/68] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:32.444902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.445193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.445502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.468631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22e27b-2a77-4ea1-aa50-c1e99c84df06 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:32.474121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:32.477351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:32.578614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:32.592010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 37/69] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:32.643826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22e27b-2a77-4ea1-aa50-c1e99c84df06 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:32.654674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:32.724510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:32.725163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.725470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.725741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.743746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:32.749363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:32.750211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:32.750973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:32.752957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:32.754485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 33/70] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:32.755476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:32.806929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da383-00b3-47eb-ae3f-7c9bd04d377d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:32.843708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:32.844274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.844532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.844973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.856039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:32.862493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:32.863538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:32.864453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 38/71] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:32.865289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:32.870926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b004-7724-4079-b6d3-f82847bb2cb1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:32.880855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:32.905772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fec51f-5516-449c-ad03-80d7f3ef37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:32.906621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fec51f-5516-449c-ad03-80d7f3ef37e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.907062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fec51f-5516-449c-ad03-80d7f3ef37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.907479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fec51f-5516-449c-ad03-80d7f3ef37e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.917906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fec51f-5516-449c-ad03-80d7f3ef37e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d1fec51f-5516-449c-ad03-80d7f3ef37e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:32.923013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:32.924045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:32.925661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 34/72] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:32.926842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365021f4-7c81-4750-bd32-3a4eb44f97d1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:32.926842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365021f4-7c81-4750-bd32-3a4eb44f97d1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:32.927040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365021f4-7c81-4750-bd32-3a4eb44f97d1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:32.928344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 35/73] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:32.929036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365021f4-7c81-4750-bd32-3a4eb44f97d1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:32.979803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720920-147a-415d-a72e-9b36d87f144a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:32.991279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.014967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.015738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.016356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.016647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.017621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:33.017968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.019489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.037290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365021f4-7c81-4750-bd32-3a4eb44f97d1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.043363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 39/74] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.043363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.080130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.080884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.081165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.081464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.082117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:33.082417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.083813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.095657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 36/75] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.096949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.126332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.144780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1494d-7f96-4c46-b0fd-4d629fcdc593 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.179475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc8bb-6177-4982-bf97-4a6ac981e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.180099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc8bb-6177-4982-bf97-4a6ac981e437 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.180376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc8bb-6177-4982-bf97-4a6ac981e437 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.180647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc8bb-6177-4982-bf97-4a6ac981e437 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.190621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc8bb-6177-4982-bf97-4a6ac981e437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:33.194805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521ded8-04a9-459c-b568-e97b46884c27 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0b1fc8bb-6177-4982-bf97-4a6ac981e437 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:33.195421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:33.196252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:33.197013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 40/76] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:33.198052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.198263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.198512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.215431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:33.216614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:33.232603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.233199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.233496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.233763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.234410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:33.234705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.236067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.242944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.244380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 37/77] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.246016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.285022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 41/78] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:33.285925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.339561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.354495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8db8a-b587-4380-a447-e667c9a8b9ea None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.389502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.390216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.390497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.390774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.403774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311163cb-e9f7-496f-a411-dc0b74660b7b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.405727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.407183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.414111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 38/79] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.414111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.443158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.443784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.444063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.444336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.445739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.447179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.448745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 42/80] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.449524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.484168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.523255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9333-4bfa-4ac3-869e-a395642025b0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.557179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228e81c-1660-41e1-ac7a-c4f361f93bea None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.560440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.561043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.561368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.561641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.562295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:33.562595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.563985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.572300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 39/81] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.573098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.589915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.593259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.594057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.594333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.594604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.595733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.597675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.599273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 43/82] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:33.600031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.685655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff02b0-ae44-4bf7-8d4a-80b0f5046b35 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.698900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.702467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f7c9-4a78-4342-8863-999a8cac045d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:33.719207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.719918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.720289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.720626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.737043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:33.737692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:33.738009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:33.738307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:33.788143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.789925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.803579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.806724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:33.808180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:33.886849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 40/83] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:33.887600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.901036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:33.905629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 44/84] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:33.906438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:33.990366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fa04c-d901-4dcb-ad36-b769900190be None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.002938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7e35-a079-476c-81ea-4d622b0ea05e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.003782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.025042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.025686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.025967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.026237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.027328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.028768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.030433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 41/85] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:34.031189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.038357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.038984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.039280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.039531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.040634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.042078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.043632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 45/86] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:33 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:34.044375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.108382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.131433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ba58-e916-4108-b87d-1c1c1d6d73fd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.142435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b30cf-550b-414c-994e-1cc141d7da02 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.164515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.165108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.165421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.165694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.175979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.176593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.176872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.177145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.178287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.179721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.181356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 46/87] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:34.182106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.216889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.236010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.238035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.279521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e68d1-b486-48cb-b39a-b54c545d2a2b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.313273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.313887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.314164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.314431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.316069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.317532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.319247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 47/88] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:34.319974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.322448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.337912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 42/89] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:34.338832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.417694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.426621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6ca9-d096-4f2c-8fc5-f4810b42b861 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.437396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c3e8-d7d9-4a5f-9982-94045d89dc65 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.463806 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.464472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.464793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.465086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.465795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.467289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.473385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.473990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.474273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.474547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.540677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.542185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.579352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 48/90] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:24:34 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:34.579906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.628848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.649829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 43/91] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:34.650640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.674664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.722873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd98089-c572-42da-addc-7bf16f391041 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.762939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.763553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.763829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.764097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.764821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=fa556f2cd54b4d48b2a814a881a5d7d5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:34.765121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.766703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54125d-34a1-4767-9256-fc8f7b7890a8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.768722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.778208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 49/92] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/role_assignments?user.id=fa556f2cd54b4d48b2a814a881a5d7d5&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:34.779632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.812778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:34.814214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:34.814214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:34.814214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:34.818053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=370ac9ef52ea4ad6930fdc193054ac74) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:34.818053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:34.819457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:34.829609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 44/93] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/role_assignments?user.id=370ac9ef52ea4ad6930fdc193054ac74&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:34.832201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:34.907799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.926151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e172b0-ad62-437e-857d-a0c5d30ab409 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:34.981495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:34.990220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142d1e-f6fe-4f7e-b26b-e400f4e6ca6c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:35.005587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:35.006260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:35.006724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:35.007265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:35.008561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:35.011072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:35.013203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 50/94] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:35.020487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:35.042614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:35.043723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:35.044112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:35.044484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] PATH_INFO: `/v3/projects/751bb5936dc8449499a7304dd0dc6f4e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:35.046509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] RBAC: Authorizing `identity:get_project(project_id=751bb5936dc8449499a7304dd0dc6f4e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:35.048516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:35.051113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 45/95] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:34 2022] GET /identity/v3/projects/751bb5936dc8449499a7304dd0dc6f4e => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:35.058837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:35.150434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebfc47-0d96-450e-a426-7b1745454c5b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:35.200976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf63dd-9b10-4432-b64f-d2429d2580fc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:35.207816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:35.208680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:35.209108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:35.209571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:35.210447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] RBAC: Adding query filter params (role.id=b06842f53bac40fc821b025679907505, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=fa556f2cd54b4d48b2a814a881a5d7d5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:35.210910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:35.212996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7070e-da7e-4dcc-a29b-c91a45f57f7a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:35.220192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 51/96] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:35 2022] GET /identity/v3/role_assignments?user.id=fa556f2cd54b4d48b2a814a881a5d7d5&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=b06842f53bac40fc821b025679907505 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:35.228691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:35.258471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:35.259330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:35.259779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:35.260197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:35.261065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=751bb5936dc8449499a7304dd0dc6f4e, user.id=fa556f2cd54b4d48b2a814a881a5d7d5) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:35.261565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:35.263200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772eef3-3b8d-451c-93c1-476babacc58d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:35.270631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 46/97] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:35 2022] GET /identity/v3/role_assignments?user.id=fa556f2cd54b4d48b2a814a881a5d7d5&scope.project.id=751bb5936dc8449499a7304dd0dc6f4e&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:37.439886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add5c4b-8253-46f3-82ef-8c9d5cb22762 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:37.440906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add5c4b-8253-46f3-82ef-8c9d5cb22762 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:37.441424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add5c4b-8253-46f3-82ef-8c9d5cb22762 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:37.443004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 52/98] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:37.448513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc80b2-2ae9-4122-b8a1-0b81fbbd3f54 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:37.449357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc80b2-2ae9-4122-b8a1-0b81fbbd3f54 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:37.449831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc80b2-2ae9-4122-b8a1-0b81fbbd3f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:37.478189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0afc80b2-2ae9-4122-b8a1-0b81fbbd3f54 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:37.479737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0afc80b2-2ae9-4122-b8a1-0b81fbbd3f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:37.573364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 47/99] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:37.867808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0997cc-5cd4-4c86-88eb-d45b5e024fba None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:37.868479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0997cc-5cd4-4c86-88eb-d45b5e024fba None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:37.868984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0997cc-5cd4-4c86-88eb-d45b5e024fba None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:37.870568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 53/100] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:37.875858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:37.876955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:37.885427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:37.906328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:37.907652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:37.994067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 48/101] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:38.030898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0997cc-5cd4-4c86-88eb-d45b5e024fba None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.105759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:38.169926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0997cc-5cd4-4c86-88eb-d45b5e024fba None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:38.216659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c543-43f6-442c-a249-6e790a8b2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:38.217331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c543-43f6-442c-a249-6e790a8b2f37 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.217624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c543-43f6-442c-a249-6e790a8b2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.217886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c543-43f6-442c-a249-6e790a8b2f37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.235199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41c543-43f6-442c-a249-6e790a8b2f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4e41c543-43f6-442c-a249-6e790a8b2f37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:38.241016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:38.241912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:38.243260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 54/102] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:38.248036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.296970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:38.303374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba884b-f289-4738-941d-5b0d509b7bf4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.303660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba884b-f289-4738-941d-5b0d509b7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.303937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba884b-f289-4738-941d-5b0d509b7bf4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.305324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 55/103] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:38.311521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104369-043c-440c-b343-45314a112326 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.311811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104369-043c-440c-b343-45314a112326 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.313574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104369-043c-440c-b343-45314a112326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.351772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-56104369-043c-440c-b343-45314a112326 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:38.353126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-56104369-043c-440c-b343-45314a112326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:38.412680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a7239-443d-4af8-bd09-d376dc3d7a64 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:38.474454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 56/104] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:38.475321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104369-043c-440c-b343-45314a112326 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.486096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:38.486781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.487074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.487351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.488032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:38.488335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:38.489758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:38.508134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 49/105] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:38.514099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.559290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:38.674076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:38.680365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413eaee-d8db-4ffe-bce3-6a2a0d3d261a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:38.691322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104369-043c-440c-b343-45314a112326 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:38.744369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240d1b-dff4-49cd-9add-e1444a34f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:38.744924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240d1b-dff4-49cd-9add-e1444a34f93b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.745204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240d1b-dff4-49cd-9add-e1444a34f93b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.745500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240d1b-dff4-49cd-9add-e1444a34f93b None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.747306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240d1b-dff4-49cd-9add-e1444a34f93b None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:38.749258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240d1b-dff4-49cd-9add-e1444a34f93b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:38.750540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 50/106] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:38.756874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e04a2-33ae-4400-a733-0ccdd442e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:38.757542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c2c7-611c-4645-8161-e28a0d799a59 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.757647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e04a2-33ae-4400-a733-0ccdd442e12e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.757879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e04a2-33ae-4400-a733-0ccdd442e12e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.759716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e04a2-33ae-4400-a733-0ccdd442e12e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.759809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c2c7-611c-4645-8161-e28a0d799a59 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.759809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c2c7-611c-4645-8161-e28a0d799a59 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.761258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 51/107] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:38.762590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aad34e-3430-4479-a9a2-ea1982a91f90 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.763077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aad34e-3430-4479-a9a2-ea1982a91f90 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.763536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aad34e-3430-4479-a9a2-ea1982a91f90 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.765366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 52/108] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:38.770744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aad34e-3430-4479-a9a2-ea1982a91f90 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.776990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e04a2-33ae-4400-a733-0ccdd442e12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f05e04a2-33ae-4400-a733-0ccdd442e12e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:38.781810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:38.783279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:38.784072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 57/109] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:38.784750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea9454-c67c-4ba0-aed1-1f328b9ea42f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.784750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea9454-c67c-4ba0-aed1-1f328b9ea42f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.784750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea9454-c67c-4ba0-aed1-1f328b9ea42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.802603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4eea9454-c67c-4ba0-aed1-1f328b9ea42f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:38.803792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4eea9454-c67c-4ba0-aed1-1f328b9ea42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:38.871030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 58/110] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:38.872242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bec39-a983-42a3-9f33-ec1f79d741a6 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.872535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bec39-a983-42a3-9f33-ec1f79d741a6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.872820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bec39-a983-42a3-9f33-ec1f79d741a6 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.874090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 59/111] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:38.875095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.875434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.875742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.892788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aad34e-3430-4479-a9a2-ea1982a91f90 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:38.895292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:38.896481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:38.923800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:38.931286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:38.932016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:38.932185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:38.932455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:38.933593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:38.935097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:38.936729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 53/112] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:38.937601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.977420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 60/113] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:38.977420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:38.979170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.051108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6a6bb-5f3c-4d4c-b692-340907293f5a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.089207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.089834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.090104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.090377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.091031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:39.091331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.092705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bc827-5c61-4505-a439-9cb907363c75 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.101475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 54/114] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:39.102787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.103075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.103349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.116319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1265c-96ed-4f68-9874-b30ef0ff0a75 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.122314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:39.123499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:39.163958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.164590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.164867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.165134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.175505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:39.180292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:39.181140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 61/115] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:39.182197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.209358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 55/116] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:39.210234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.221588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.240648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.311089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26c41f-641d-4861-845e-b86f1af7f89c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.322207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1e9db-7e12-40b8-a00d-8ea07b670b9d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.349609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.350287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.350723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.350997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/fa556f2cd54b4d48b2a814a881a5d7d5/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.353045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] RBAC: Authorizing `identity:create_grant(project_id=a419c813a6bf4516b4bfadac726c8046, user_id=fa556f2cd54b4d48b2a814a881a5d7d5, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.354532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.356206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.356834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.357116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.357419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.358527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.360089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.361742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 56/117] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:39.362506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.447455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 62/118] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:39 2022] PUT /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/fa556f2cd54b4d48b2a814a881a5d7d5/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:39.448690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.455815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.464122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fce0a3-2fed-4d27-b9fb-e748dd9aa772 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.506338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.507095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.507446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.507718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.520666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:39.525893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:39.526992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:39.527810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 57/119] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:39.529092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.583952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.592177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e98a4-9f5a-4361-b4f1-70029f11f445 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.640739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.642278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.642816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.643341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.644031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:39.644334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.645751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.654842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 63/120] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:39.655773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.655977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc317-eec9-4424-abff-1a63c805ba40 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.691860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.692486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.692767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.693040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.703370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:39.709128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:39.710300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 58/121] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:39.711128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.728580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.775563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186bd1-436a-4f76-bd83-510dfc0f2971 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.813333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.814769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.815134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.815410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.816159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b4f63-7be1-4bf6-b13b-4daddb64164c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.816543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.818047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.819848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 64/122] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:39.825182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.841201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.851925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.856183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.856183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.856183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.856183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.856183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.857374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 59/123] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:39.858038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:39.934049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5a2e-c924-41b3-9d0b-b63d43fdced1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.946890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:39.967570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454a445-b19b-4415-9d8b-65f629f12fcb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:39.973800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:39.974413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:39.974697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:39.974972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:39.975638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:39.975944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:39.977476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:39.986420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 65/124] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:39.991682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.005748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.006382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.006671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.006947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.008073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.009668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.015742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 60/125] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:40.015742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.079347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:40.105783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8330ddc-5977-4780-9119-a2fd04f57e30 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.122433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9cc3-7f97-4701-a13d-686130f5ad21 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.142970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.143599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.143877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.144145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.144802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:40.145099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.146512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.154883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 66/126] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:40.159557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.160225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.160334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.160513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.160789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/370ac9ef52ea4ad6930fdc193054ac74/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.162712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] RBAC: Authorizing `identity:create_grant(project_id=a419c813a6bf4516b4bfadac726c8046, user_id=370ac9ef52ea4ad6930fdc193054ac74, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.164684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.257855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe598c-4492-4320-94fc-80dd487c8a75 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.275445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 61/127] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:40 2022] PUT /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/370ac9ef52ea4ad6930fdc193054ac74/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:40.276434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.296364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:40.309546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.315143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.315143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.315143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.315143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.315143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.329415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:40.399240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec836140-e66c-4c47-a8fe-e405736445ad None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.435940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.436590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.436873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.437150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.438549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.440718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.441925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 62/128] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:40 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:40.447123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.453531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 67/129] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:24:40 2022] POST /identity/v3/projects => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:40.456756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.561537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:40.594429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd913aa4-1860-49d4-a0ed-1e0ca769b682 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.603294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab123-8ee5-4ee2-98ad-54b498fe0bda None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.644364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.645017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.645333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.645612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.647047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.648496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.650235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 63/130] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:40 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:40.650751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.651001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.651890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.652365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.652839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] PATH_INFO: `/v3/users/b75e88b4a92345e6888d061c29a04abd` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.674490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] RBAC: Authorizing `identity:get_user(user_id=b75e88b4a92345e6888d061c29a04abd)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.676421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.679225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 68/131] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:40 2022] GET /identity/v3/users/b75e88b4a92345e6888d061c29a04abd => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:40.680349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.756291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:40.781132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486efae-42c5-4f59-a325-916b2645df5c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.811876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f913b-adec-4fc5-bf8c-20eccadaf44c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.829099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.830174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.831008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.831549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] PATH_INFO: `/v3/projects/751bb5936dc8449499a7304dd0dc6f4e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.833193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=751bb5936dc8449499a7304dd0dc6f4e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.835247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.837864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 64/132] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:40 2022] GET /identity/v3/projects/751bb5936dc8449499a7304dd0dc6f4e => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:40.839114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:40.853965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:40.854629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:40.854912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:40.855184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/fa556f2cd54b4d48b2a814a881a5d7d5/roles/b06842f53bac40fc821b025679907505` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:40.857366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] RBAC: Authorizing `identity:create_grant(project_id=a419c813a6bf4516b4bfadac726c8046, user_id=fa556f2cd54b4d48b2a814a881a5d7d5, role_id=b06842f53bac40fc821b025679907505)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:40.858807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:40.861104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:40.962678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862523c-a92d-4062-8967-06ba71003fe4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:40.986201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 69/133] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:40 2022] PUT /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/fa556f2cd54b4d48b2a814a881a5d7d5/roles/b06842f53bac40fc821b025679907505 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:40.988317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:41.035295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:41.035295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:41.035295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:41.035295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:41.159918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:41.162302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:41.201245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:41.236695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be9521-5fbd-43ea-81b7-8f62a5d71845 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:41.248005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:41.298280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:41.298956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:41.299235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:41.299506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] PATH_INFO: `/v3/projects/751bb5936dc8449499a7304dd0dc6f4e/users/fa556f2cd54b4d48b2a814a881a5d7d5/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:41.301703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] RBAC: Authorizing `identity:create_grant(project_id=751bb5936dc8449499a7304dd0dc6f4e, user_id=fa556f2cd54b4d48b2a814a881a5d7d5, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:41.304723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:41.342663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 65/134] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:41.354162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:41.414297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 70/135] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:40 2022] PUT /identity/v3/projects/751bb5936dc8449499a7304dd0dc6f4e/users/fa556f2cd54b4d48b2a814a881a5d7d5/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:41.479300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74543f0f-2b37-4a50-bf3e-46c4a405f47b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:41.495301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:41.525943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60407075-d0b0-48f6-a394-c29429390872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:41.526592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407075-d0b0-48f6-a394-c29429390872 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:41.526868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407075-d0b0-48f6-a394-c29429390872 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:41.527138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407075-d0b0-48f6-a394-c29429390872 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:41.528403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60407075-d0b0-48f6-a394-c29429390872 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:41.529933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60407075-d0b0-48f6-a394-c29429390872 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:41.532549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 66/136] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:41 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:41.538845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:41.700120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0487488-e91d-43b8-a512-ebbc22d6fc83 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:41.735980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:41.736588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:41.736867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:41.737135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:41.737895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] RBAC: Adding query filter params (role.id=fb68dfc34fd24d0784263eac7140a91b, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=b75e88b4a92345e6888d061c29a04abd) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:41.738199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:41.739628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b67b31-d760-47eb-934f-222c4003ba68 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:41.745456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 71/137] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:41 2022] GET /identity/v3/role_assignments?user.id=b75e88b4a92345e6888d061c29a04abd&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=fb68dfc34fd24d0784263eac7140a91b => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:42.386913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff136f-63c0-46da-a7bb-5827bf70e21f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:42.387451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff136f-63c0-46da-a7bb-5827bf70e21f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:42.387451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff136f-63c0-46da-a7bb-5827bf70e21f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:42.388801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 67/138] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:42.394905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b75bc-ab9e-4e65-ab65-4991af52290d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:42.395188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b75bc-ab9e-4e65-ab65-4991af52290d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:42.395460 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b75bc-ab9e-4e65-ab65-4991af52290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:42.423204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-296b75bc-ab9e-4e65-ab65-4991af52290d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:42.424457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-296b75bc-ab9e-4e65-ab65-4991af52290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:42.455965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:42.511362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 72/139] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:43.058666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff136f-63c0-46da-a7bb-5827bf70e21f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:43.088774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb5fb9-7191-4d77-bc54-c181887e0d65 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:43.089328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb5fb9-7191-4d77-bc54-c181887e0d65 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:43.089328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb5fb9-7191-4d77-bc54-c181887e0d65 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:43.090673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 73/140] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:43.096522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:43.096803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:43.097075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:43.138537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:43.139757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:43.248870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff136f-63c0-46da-a7bb-5827bf70e21f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:43.269666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 74/141] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 11:24:43.295093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:43.295717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:43.296004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:43.296275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:43.310837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:43.315667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:43.316534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:43.317357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 68/142] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:43.322801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:43.440492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:43.449598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee15c7-6c96-481c-acd9-1b952112665f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:43.497193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:43.497830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:43.498112 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:43.498382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:43.499041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:43.499344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:43.501055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:43.512303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 75/143] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:43.519281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:43.579112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:43.647955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54313-3eaf-4909-b2e0-d43ddbe347de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:43.693469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:43.694105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:43.694379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:43.694648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:43.695788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:43.697240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:43.698833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 69/144] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:43 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:43.704497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:43.827702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240dd40-0f8a-4dd7-85a9-826d26bc85e7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:43.866524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:43.906300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c59f-2d2f-4289-bc32-83a2e4579098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:43.906931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c59f-2d2f-4289-bc32-83a2e4579098 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:43.907214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c59f-2d2f-4289-bc32-83a2e4579098 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:43.907507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c59f-2d2f-4289-bc32-83a2e4579098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:43.961440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:44.038107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4c59f-2d2f-4289-bc32-83a2e4579098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:44.039586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4c59f-2d2f-4289-bc32-83a2e4579098 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:44.084411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d484c0-560b-4385-a070-ae2b1a54c798 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.104054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:44.128431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262ce5-df91-4a0d-970b-2e6e3f4e8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:44.129107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262ce5-df91-4a0d-970b-2e6e3f4e8098 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.129423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262ce5-df91-4a0d-970b-2e6e3f4e8098 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.129701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262ce5-df91-4a0d-970b-2e6e3f4e8098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.142042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56262ce5-df91-4a0d-970b-2e6e3f4e8098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-56262ce5-df91-4a0d-970b-2e6e3f4e8098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:44.148934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:44.149840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:44.150607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 70/145] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:44.154017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bea5f-1a05-4e27-8005-c773c93e7e44 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.154726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bea5f-1a05-4e27-8005-c773c93e7e44 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.155011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bea5f-1a05-4e27-8005-c773c93e7e44 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.156798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 71/146] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:44.158644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c5e3-5127-4d42-93fe-23e5a653b398 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.159078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c5e3-5127-4d42-93fe-23e5a653b398 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.159485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c5e3-5127-4d42-93fe-23e5a653b398 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.161890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 72/147] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:44.162954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01c5e3-5127-4d42-93fe-23e5a653b398 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:44.185656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 76/148] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:44.187671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447c882-99d6-4cd4-ab60-9a4d61f194b6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.188644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447c882-99d6-4cd4-ab60-9a4d61f194b6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.189105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447c882-99d6-4cd4-ab60-9a4d61f194b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.208219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8447c882-99d6-4cd4-ab60-9a4d61f194b6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:44.209814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8447c882-99d6-4cd4-ab60-9a4d61f194b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:44.264359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:44.278128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01c5e3-5127-4d42-93fe-23e5a653b398 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.283807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 77/149] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:44.290827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.291121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.291387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.317925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:44.318762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.319199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.319600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.320407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:44.320839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:44.322372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:44.329229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:44.330492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:44.331839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 73/150] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:44.332776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:44.378242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:44.458158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 78/151] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:44.459202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:44.461931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0887dd-38fc-4a93-a3a7-245ab30b56fe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.501955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:44.502931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.503370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.503775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.505145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:44.507031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:44.509286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 74/152] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:44 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:44.521797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:44.666618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952941-87a8-484a-8408-87e9c2c4839c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.690833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:44.716047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:44.716047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.716522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.716932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] PATH_INFO: `/v3/users/370ac9ef52ea4ad6930fdc193054ac74` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.718356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] RBAC: Authorizing `identity:get_user(user_id=370ac9ef52ea4ad6930fdc193054ac74)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:44.720154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:44.722016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 79/153] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:44 2022] GET /identity/v3/users/370ac9ef52ea4ad6930fdc193054ac74 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:44.728810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:44.782509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:44.793800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca842bf4-65fd-48f8-bbef-2e1673b4d0dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.840687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:44.841319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.841780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.842188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.843055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=fa556f2cd54b4d48b2a814a881a5d7d5) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:44.843513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:44.845515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:44.851571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 75/154] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:44 2022] GET /identity/v3/role_assignments?user.id=fa556f2cd54b4d48b2a814a881a5d7d5&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:44.852516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:44.854804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243769-a2df-4d32-b64a-d0a4592d0e52 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.903274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:44.903913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:44.904192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:44.904464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:44.973846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4eceb-7121-4d42-a156-a9bf624a2325 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:44.978264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.005046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.007124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.016118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f784ba-8275-434c-acda-2b0fdddb059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.017201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f784ba-8275-434c-acda-2b0fdddb059c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.017707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f784ba-8275-434c-acda-2b0fdddb059c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.018109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f784ba-8275-434c-acda-2b0fdddb059c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.019466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f784ba-8275-434c-acda-2b0fdddb059c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.021100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f784ba-8275-434c-acda-2b0fdddb059c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.022965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 76/155] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:45.030405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2152dbe-ad60-4c23-b0d1-8df031081282 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.030932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2152dbe-ad60-4c23-b0d1-8df031081282 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.032001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2152dbe-ad60-4c23-b0d1-8df031081282 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.033868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 77/156] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:45.034810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2152dbe-ad60-4c23-b0d1-8df031081282 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.080195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.142321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 80/157] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:24:45.143464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.168466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2152dbe-ad60-4c23-b0d1-8df031081282 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.203360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548180d6-36c3-461d-963a-d1b316ec2719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.203954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548180d6-36c3-461d-963a-d1b316ec2719 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.204224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548180d6-36c3-461d-963a-d1b316ec2719 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.204488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548180d6-36c3-461d-963a-d1b316ec2719 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.214235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548180d6-36c3-461d-963a-d1b316ec2719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-548180d6-36c3-461d-963a-d1b316ec2719 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:45.219890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:45.220761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:45.221578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 78/158] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:45.222446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf57d8-71d8-47bc-a796-efde33d6bf45 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.222446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf57d8-71d8-47bc-a796-efde33d6bf45 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.222687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf57d8-71d8-47bc-a796-efde33d6bf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.231496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.241700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aacf57d8-71d8-47bc-a796-efde33d6bf45 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:45.242928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aacf57d8-71d8-47bc-a796-efde33d6bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:45.249586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67100cb1-fec8-4250-a29c-9735ae32c09d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.284057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.284655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.284925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.285191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.285870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.287287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.310385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 79/159] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:45.311722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ca57b-fedf-4bcd-9943-48e09895f123 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.312091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ca57b-fedf-4bcd-9943-48e09895f123 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.312951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ca57b-fedf-4bcd-9943-48e09895f123 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.314540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 80/160] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:45.317404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ca57b-fedf-4bcd-9943-48e09895f123 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.343023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.370560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 81/161] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:24:45 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:45.371682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.456527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ca57b-fedf-4bcd-9943-48e09895f123 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.500318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f020a6-ed60-4de7-9734-9134bb9b8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.501290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f020a6-ed60-4de7-9734-9134bb9b8795 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.501795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f020a6-ed60-4de7-9734-9134bb9b8795 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.502288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f020a6-ed60-4de7-9734-9134bb9b8795 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.503902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f020a6-ed60-4de7-9734-9134bb9b8795 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.505810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f020a6-ed60-4de7-9734-9134bb9b8795 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.507801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 81/162] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:45.509163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.509667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.510157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.512702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee181c-3f1d-4362-ad53-72130e17875e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.530829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:45.532923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:45.560055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.560917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.561194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.561498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.562160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:45.562536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.563942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.570273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.573542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 82/163] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:45.574339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.626476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 82/164] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:45.627637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.662930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.696851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186086-d22f-4073-b5a1-34836ee95454 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.734659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.735365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.735551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.735830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.736554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=370ac9ef52ea4ad6930fdc193054ac74) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:45.736912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.738413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.745033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 83/165] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/role_assignments?user.id=370ac9ef52ea4ad6930fdc193054ac74&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:45.750220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.759638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb18a6-3ed4-4144-9f94-a3d75b9490e7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.806323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.807409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.807888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.808380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.810138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:45.811923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:45.815713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 83/166] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:45.821909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:45.846168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.904464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f928d-fe1b-498e-9f57-3cf936d1cd0f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.960900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:45.961963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:45.962433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:45.962913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:45.967075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:45.976680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:45.980164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19aa3c-b406-462d-8f43-62ee5a4f4892 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:45.982064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:45.983092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:45.984009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 84/167] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:45.984670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.018418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1516-e199-4557-9742-13890a709b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.018944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1516-e199-4557-9742-13890a709b37 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.019217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1516-e199-4557-9742-13890a709b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.019481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1516-e199-4557-9742-13890a709b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.101592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b1516-e199-4557-9742-13890a709b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.103126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b1516-e199-4557-9742-13890a709b37 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:46.112693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369474-f2ad-493f-b07a-a4da47d7fbb3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.146028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:46.160667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.161419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.161698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.164281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.178179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:46.183283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:46.184368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:46.185156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:46.188138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 85/168] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:46.189177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.222244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:46.235633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 84/169] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:46.236553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1516-e199-4557-9742-13890a709b37 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.316067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985d631-efa0-48ad-b51a-ad04b5fc92ac None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.350273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1516-e199-4557-9742-13890a709b37 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.358863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.360590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.361095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.361620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.362449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:46.363022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.364563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:46.382970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 86/170] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:46.384089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.413991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.414701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.415050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.415388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.416132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:46.416492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.417988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:46.437480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 85/171] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:46.438698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.449345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:46.524533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:46.571467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c35407-d463-4ec6-991a-d79eb4846f5e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.585186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31dab-9e7e-4346-ae49-74dfbee419e5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.627365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.628295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.628816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.629265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] PATH_INFO: `/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.631225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] RBAC: Authorizing `identity:get_user(user_id=fa556f2cd54b4d48b2a814a881a5d7d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.632818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:46.634847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 86/172] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/users/fa556f2cd54b4d48b2a814a881a5d7d5 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:46.636133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.669142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.669812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.670085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.670354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.671622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.673430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:46.675159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 87/173] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:46.675733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.758733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaeb78-bf9f-482a-b462-31e983f0903a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.785633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:46.806476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.807583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.808018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.808451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] PATH_INFO: `/v3/users/b75e88b4a92345e6888d061c29a04abd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.811032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] RBAC: Authorizing `identity:get_user(user_id=b75e88b4a92345e6888d061c29a04abd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.815291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:46.820352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 87/174] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/users/b75e88b4a92345e6888d061c29a04abd => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:46.821436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:46.951592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904df9-a394-4092-b9dd-c13d6369cb9b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.973349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254b6b-0272-4a42-9173-27be7c16cccf None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:46.989043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:46.990209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:46.990690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:46.991145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:46.992028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] RBAC: Adding query filter params (role.id=b06842f53bac40fc821b025679907505, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=fa556f2cd54b4d48b2a814a881a5d7d5) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:46.992627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:46.994302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:47.000687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 88/175] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/role_assignments?user.id=fa556f2cd54b4d48b2a814a881a5d7d5&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=b06842f53bac40fc821b025679907505 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:47.006007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:47.026699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:47.109667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:47.110102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:47.110942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:47.111068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:47.111262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:47.166869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58699b-09eb-4ee1-ab93-173e9fc44de6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:47.220340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:47.222133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:47.222413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:47.222683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:47.224897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:47.227753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:47.236020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 89/176] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:47 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:47.246295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:47.290479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:47.292046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:47.434821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 88/177] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:47.440851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:47.461585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:47.467370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50666c-6062-4809-ba08-d80568006259 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:47.505738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:47.550410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549ae77-7bd9-44ee-9238-e5b31aa629ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:47.551082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ae77-7bd9-44ee-9238-e5b31aa629ab None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:47.551354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ae77-7bd9-44ee-9238-e5b31aa629ab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:47.553966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bcdb7-a4a0-4d74-b8e2-dab49b2ea415 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:47.554100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ae77-7bd9-44ee-9238-e5b31aa629ab None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/b75e88b4a92345e6888d061c29a04abd/roles/fb68dfc34fd24d0784263eac7140a91b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:47.555235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549ae77-7bd9-44ee-9238-e5b31aa629ab None admin] RBAC: Authorizing `identity:create_grant(project_id=a419c813a6bf4516b4bfadac726c8046, user_id=b75e88b4a92345e6888d061c29a04abd, role_id=fb68dfc34fd24d0784263eac7140a91b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:47.556693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549ae77-7bd9-44ee-9238-e5b31aa629ab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:47.589688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:47.590331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:47.590665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:47.590937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] PATH_INFO: `/v3/projects/751bb5936dc8449499a7304dd0dc6f4e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:47.592080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] RBAC: Authorizing `identity:get_project(project_id=751bb5936dc8449499a7304dd0dc6f4e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:47.594417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:47.596115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 89/178] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:47 2022] GET /identity/v3/projects/751bb5936dc8449499a7304dd0dc6f4e => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:47.602168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:47.644261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 90/179] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:47 2022] PUT /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046/users/b75e88b4a92345e6888d061c29a04abd/roles/fb68dfc34fd24d0784263eac7140a91b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:47.701978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:47.719879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0eed-b8b0-4ede-8c91-3c83154a6bfe None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:47.758319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:47.758853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:47.759129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:47.759397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:47.760200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=751bb5936dc8449499a7304dd0dc6f4e, user.id=fa556f2cd54b4d48b2a814a881a5d7d5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:47.760511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:47.762098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4fb48-7762-46a6-a991-e762d20c3079 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:47.773699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 90/180] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:47 2022] GET /identity/v3/role_assignments?user.id=fa556f2cd54b4d48b2a814a881a5d7d5&scope.project.id=751bb5936dc8449499a7304dd0dc6f4e&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:48.436221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ca69-4b13-47fd-b446-d32eacb7fcc0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.436556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ca69-4b13-47fd-b446-d32eacb7fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.436854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ca69-4b13-47fd-b446-d32eacb7fcc0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.438330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 91/181] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:48.443871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b398-7764-4ceb-936d-510e5309cabf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.444307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b398-7764-4ceb-936d-510e5309cabf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.444494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b398-7764-4ceb-936d-510e5309cabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.463074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7459b398-7764-4ceb-936d-510e5309cabf None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:48.464283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7459b398-7764-4ceb-936d-510e5309cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:48.538600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 91/182] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:48.603889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eca336-e002-4fa4-b1a5-c1621709f98f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.604167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eca336-e002-4fa4-b1a5-c1621709f98f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.604699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eca336-e002-4fa4-b1a5-c1621709f98f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.606735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 92/183] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:48.613988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7fc72-5b55-4c59-966d-7dd1c9a43583 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.614606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7fc72-5b55-4c59-966d-7dd1c9a43583 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.615102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7fc72-5b55-4c59-966d-7dd1c9a43583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.637876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-41f7fc72-5b55-4c59-966d-7dd1c9a43583 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:48.639386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-41f7fc72-5b55-4c59-966d-7dd1c9a43583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:48.710547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 92/184] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:48.738155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69275f04-4f7f-4829-89e9-1ff7df79dfc2 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.738978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69275f04-4f7f-4829-89e9-1ff7df79dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.739415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69275f04-4f7f-4829-89e9-1ff7df79dfc2 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.740884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 93/185] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:48.746160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.746606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.747026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.759842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:48.768057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:48.769522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:48.826309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69275f04-4f7f-4829-89e9-1ff7df79dfc2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:48.853363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 93/186] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:48.933259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69275f04-4f7f-4829-89e9-1ff7df79dfc2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.002341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.003527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.003999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.004455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.006658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.016996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:49.022699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:49.023602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:49.024402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 94/187] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:49.029756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.075607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.138605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08f69-3fee-4a8d-8b29-e9fc2769a93b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.149008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fe406-80f8-49ae-89fc-29de0e24e6a2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.183049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.183696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.183974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.184242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.186110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.187208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.187594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.187918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.188415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.189659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:49.190253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.192845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.197355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:49.203693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:49.204596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:49.205875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:49.206494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 95/188] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:49.206494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.209777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 94/189] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:49.210482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.311134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.314063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7fc72-6236-4012-add9-db43c8a437aa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.327955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7fec0-1ff3-4e48-a16d-739403635931 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.351012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.351627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.351917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.352452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.353306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.354736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.356444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 96/190] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:49.357025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.367935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.368553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.368830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.369095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] PATH_INFO: `/v3/users/8013af70a957445180db1cdad869b5b7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.383705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] RBAC: Authorizing `identity:get_user(user_id=8013af70a957445180db1cdad869b5b7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.385154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.391935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 95/191] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/users/8013af70a957445180db1cdad869b5b7 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:49.391935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.452825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.467777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99af93-2d94-4e6f-97f6-775c9b9c745e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.497971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70443af7-f02a-4c51-96dc-8f9e8f723324 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.503038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.503640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.503912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.504178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.504825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:49.505118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.506537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.520771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 97/192] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:49.520771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.536266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.536876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.537157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.537553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.538204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.539706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.554537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.624929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca8d2-38c6-421c-ad12-c68ac52c2f81 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.649409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 96/193] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:24:49 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:49.654311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.669693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.670842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.671890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.672448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.775821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.778823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.782870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7156ce7-68b4-49b9-9d0b-06b531d54d58 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:49.800261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.822738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:49.831610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:49.832366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:49.832742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:49.833335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] PATH_INFO: `/v3/users/8013af70a957445180db1cdad869b5b7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:49.835027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] RBAC: Authorizing `identity:get_user(user_id=8013af70a957445180db1cdad869b5b7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:49.838673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:49.841128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 97/194] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/users/8013af70a957445180db1cdad869b5b7 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:49.847600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.911646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 98/195] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:49.918588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:49.971117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137bbe-355f-4e76-ac2e-f1db3b67639b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:50.015985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d454a-c386-47fc-acbe-a5c0d076d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:50.016796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d454a-c386-47fc-acbe-a5c0d076d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.017108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d454a-c386-47fc-acbe-a5c0d076d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.017396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d454a-c386-47fc-acbe-a5c0d076d2e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.034825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c5bd-ccfd-432a-be09-fc501ea18e64 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:50.074542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:50.081174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:50.081889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:50.087810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.087810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.087810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.087810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:50.087810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:50.089951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 99/196] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:50.096022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:50.108846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d454a-c386-47fc-acbe-a5c0d076d2e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:50.111387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d454a-c386-47fc-acbe-a5c0d076d2e0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:50.229700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 98/197] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:24:50.230968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18c7c-6c97-4389-84b9-46cf250cf0af None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.231342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18c7c-6c97-4389-84b9-46cf250cf0af None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.231668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18c7c-6c97-4389-84b9-46cf250cf0af None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.233015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 99/198] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:50.235071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae149380-b04c-460a-9da6-d3346d01bbc8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:50.238081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18c7c-6c97-4389-84b9-46cf250cf0af None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:50.282848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:50.283448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.283721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.283985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.284776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=8013af70a957445180db1cdad869b5b7) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:50.285111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:50.287152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed1524-2c6b-489d-bfbe-742a22bc7c1a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:50.293727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 100/199] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:50 2022] GET /identity/v3/role_assignments?user.id=8013af70a957445180db1cdad869b5b7&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:50.298625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.298625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.298625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.332380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:50.335194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:50.364169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:50.401774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18c7c-6c97-4389-84b9-46cf250cf0af None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:50.459883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:50.474700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:50.475339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.475620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.475887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.477771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:50.479227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:50.482249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 100/200] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:50 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:50.485350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 101/201] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:50.490442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:50.600299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734e4d-1a46-4591-82d9-1db7cdae3426 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:50.652335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:50.652989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:50.653285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:50.653552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:50.654277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] RBAC: Adding query filter params (role.id=b06842f53bac40fc821b025679907505, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=8013af70a957445180db1cdad869b5b7) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:50.654577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:50.656092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:50.665268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 101/202] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:50 2022] GET /identity/v3/role_assignments?user.id=8013af70a957445180db1cdad869b5b7&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=b06842f53bac40fc821b025679907505 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:50.918735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:51.057096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a800baa-dc98-46ad-bbd5-689a0b3a5652 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:51.102730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:51.103361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:51.103634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:51.103894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:51.117961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:51.122678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:51.124116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:51.125044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 102/203] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:51.130405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:51.150647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:51.270061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826a27b-bf16-4a8a-8c63-c7c45ec3b32f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:51.325907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:51.326521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:51.326861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:51.327129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:51.327796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:51.328094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:51.329486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:51.338203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 102/204] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:51.344542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:51.411432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:51.478896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3be2f-837c-4369-925b-6b6affab5bf9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:51.526916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:51.527509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:51.527795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:51.528063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] PATH_INFO: `/v3/users/b75e88b4a92345e6888d061c29a04abd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:51.533049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] RBAC: Authorizing `identity:get_user(user_id=b75e88b4a92345e6888d061c29a04abd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:51.534557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:51.536483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 103/205] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:51 2022] GET /identity/v3/users/b75e88b4a92345e6888d061c29a04abd => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:51.541633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:51.646276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:51.677555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcede0f3-e6c5-436a-a50e-1bdc3d22e551 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:51.723466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:51.724134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:51.724417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:51.724686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:51.809146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:51.810730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:51.902128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:51.973145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 103/206] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:51.978611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:52.094267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97feaf1-c7dc-4a90-96b1-4506323b4c7e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:52.114829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:52.129603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99fd9-56fe-4655-90d6-892b78443444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:52.134498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99fd9-56fe-4655-90d6-892b78443444 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:52.134498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99fd9-56fe-4655-90d6-892b78443444 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:52.134498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99fd9-56fe-4655-90d6-892b78443444 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:52.134498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99fd9-56fe-4655-90d6-892b78443444 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:52.134498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99fd9-56fe-4655-90d6-892b78443444 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:52.134937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 104/207] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:51 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:52.141934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:52.296457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a2151-b0e0-4555-ad37-0362d1ece1c9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:52.339069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:52.339904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:52.340364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:52.340772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:52.341718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] RBAC: Adding query filter params (role.id=fb68dfc34fd24d0784263eac7140a91b, scope.project.id=a419c813a6bf4516b4bfadac726c8046, user.id=b75e88b4a92345e6888d061c29a04abd) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:52.343061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:52.346341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a045a24-faa9-4442-9074-0f81068e1f4d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:52.357842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 104/208] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:52 2022] GET /identity/v3/role_assignments?user.id=b75e88b4a92345e6888d061c29a04abd&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=fb68dfc34fd24d0784263eac7140a91b => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:52.665341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3140-ddf6-482b-8103-4b561a8502b2 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:52.665865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3140-ddf6-482b-8103-4b561a8502b2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:52.666271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3140-ddf6-482b-8103-4b561a8502b2 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:52.667790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 105/209] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:52.674197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:52.675074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:52.675543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:52.696735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:52.698020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:52.713253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c715eb-c9a7-40b4-a143-170b30cf49e1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:52.713253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c715eb-c9a7-40b4-a143-170b30cf49e1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:52.713253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c715eb-c9a7-40b4-a143-170b30cf49e1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:52.714685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 106/210] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:52.720425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:52.720966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:52.721511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:52.731895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:52.750358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:52.751935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:52.776421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 105/211] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:52.845196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 107/212] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:53.051659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.132411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.164957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9389-d293-471e-bf06-f5d0e8af5c34 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.204122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294903f-4212-4d9e-a7af-2f49ff9d0c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.204848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294903f-4212-4d9e-a7af-2f49ff9d0c94 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.205245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294903f-4212-4d9e-a7af-2f49ff9d0c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.205514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294903f-4212-4d9e-a7af-2f49ff9d0c94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.206612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294903f-4212-4d9e-a7af-2f49ff9d0c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:53.208103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294903f-4212-4d9e-a7af-2f49ff9d0c94 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:53.209872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 106/213] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:53.210801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a35c6-db7b-42f1-8831-6081d3f83515 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.211107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a35c6-db7b-42f1-8831-6081d3f83515 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.211343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a35c6-db7b-42f1-8831-6081d3f83515 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.212666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 107/214] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:53.214261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0fd14-7dca-4ad6-b109-09445cf6759e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.214645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0fd14-7dca-4ad6-b109-09445cf6759e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.214805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0fd14-7dca-4ad6-b109-09445cf6759e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.216045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 108/215] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:53.216722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0fd14-7dca-4ad6-b109-09445cf6759e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.253475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ac97-4adc-4ea6-95dd-ee18020efb68 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.258310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.271008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.287714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23f6ef-9f13-45a0-9387-ddda3ce82fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.288327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f6ef-9f13-45a0-9387-ddda3ce82fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.288599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f6ef-9f13-45a0-9387-ddda3ce82fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.288862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f6ef-9f13-45a0-9387-ddda3ce82fa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.298631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23f6ef-9f13-45a0-9387-ddda3ce82fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6d23f6ef-9f13-45a0-9387-ddda3ce82fa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:53.303435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:53.304324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:53.305122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:53.309483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 108/216] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:53.309483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b444b-760b-4156-aa5e-becdb0e25f0f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.309483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b444b-760b-4156-aa5e-becdb0e25f0f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.309483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b444b-760b-4156-aa5e-becdb0e25f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.325150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3a3b444b-760b-4156-aa5e-becdb0e25f0f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:53.326387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3a3b444b-760b-4156-aa5e-becdb0e25f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:53.328371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0fd14-7dca-4ad6-b109-09445cf6759e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.362336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.362928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.363200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.363465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.364103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:53.365560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:53.392580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 109/217] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:53.393981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.394266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.394541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.412203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:53.413395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:53.461242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 109/218] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:24:53 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:53.461242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.485354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 110/219] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:53.579593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.589916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f994-5b4b-46cb-9ca1-a3982131df14 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.630131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.630760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.631103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.631378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.632062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:53.632361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:53.633805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:53.646130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 110/220] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:53.650701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.679150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.698559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.774600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6bbe-6234-4153-ab4a-c530e8e4ff7d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.807225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffa345-1512-4851-a321-7108b96b331d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.816000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.816631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.817064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.817510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] PATH_INFO: `/v3/users/d1508f84211544bf97a2f692b6e6488c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.836792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] RBAC: Authorizing `identity:get_user(user_id=d1508f84211544bf97a2f692b6e6488c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:53.838520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:53.840635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 111/221] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/users/d1508f84211544bf97a2f692b6e6488c => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:53.841568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.849288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.849931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.850208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.850477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.863091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:53.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:53.869020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 111/222] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:53.870192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.888530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.967982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.975982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a2f77-5ea9-4851-81cd-169fa2205830 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.999473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75412a-b13a-42c9-874c-89ca029423d3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.024172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.025726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.026329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.026877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.040195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.041179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.041548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.041744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:54.041882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:54.048307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:54.049200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:54.050066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:54.050686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 112/223] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:54.051701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.126775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.128796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.145231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:54.175148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e5d-83d1-416e-a2e9-80bf624e54b3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.222113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.223478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.223985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.224709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.225606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:54.226365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.228713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.240536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 113/224] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.241698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.259721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 112/225] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:54.266159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.267338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:54.357008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3d91-f5ee-4510-854c-da3117b93e04 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.382703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec158-ca0f-43bb-af9a-f2ebd86ceaad None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.400731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.401399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.402022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:54.402129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.403161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.404370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:54.404677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.406420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.417091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 114/226] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.418569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.428481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.429856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.430243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.430648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] PATH_INFO: `/v3/users/8013af70a957445180db1cdad869b5b7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.432371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] RBAC: Authorizing `identity:get_user(user_id=8013af70a957445180db1cdad869b5b7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.434389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.437238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 113/227] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/users/8013af70a957445180db1cdad869b5b7 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.442851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.512786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:54.535647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19b53d-1868-4f78-92f0-000415bec87b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.563730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c187-aa03-4914-8d43-0bab5330996b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.573432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.574057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.574334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.574602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.575711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.578129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.584704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 115/228] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.585545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.605076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.606179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.606858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.607824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] PATH_INFO: `/v3/users/8013af70a957445180db1cdad869b5b7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.609313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] RBAC: Authorizing `identity:get_user(user_id=8013af70a957445180db1cdad869b5b7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.617872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.620470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 114/229] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/users/8013af70a957445180db1cdad869b5b7 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.625588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.690083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:54.703162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f82c3-1207-4801-845c-cc6c99db6b44 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.739737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.740363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.740641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.740909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.742329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.743683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.750281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 116/230] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.750281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.753858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ee63-1c21-495e-9bce-8e3a1e161b50 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:54.766220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:54.792511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:54.793495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:54.794008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:54.794469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:54.795647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=d1508f84211544bf97a2f692b6e6488c) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:54.796202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:54.798641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:54.804745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 115/231] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/role_assignments?user.id=d1508f84211544bf97a2f692b6e6488c&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:54.805827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:54.925022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c7c1c-1eca-4d37-8923-a7a2cff616ff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:55.004100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4e7d2-ee98-4e74-b958-d61bddc285ac None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:55.012118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:55.012558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:55.012949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:55.013385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:55.014912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:55.016564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:55.024845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 117/232] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:54 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:55.025780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:55.027550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:55.050061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038346-3453-4030-8f76-2f7b2db9d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:55.050724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038346-3453-4030-8f76-2f7b2db9d93d None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:55.051005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038346-3453-4030-8f76-2f7b2db9d93d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:55.051331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038346-3453-4030-8f76-2f7b2db9d93d None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/8013af70a957445180db1cdad869b5b7/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:55.053275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1038346-3453-4030-8f76-2f7b2db9d93d None admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ff383259a46ada3cebd0e725c6559, user_id=8013af70a957445180db1cdad869b5b7, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:55.054778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1038346-3453-4030-8f76-2f7b2db9d93d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:55.131675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:55.140499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 116/233] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:54 2022] PUT /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/8013af70a957445180db1cdad869b5b7/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:55.149584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187cf8e-a8b0-44ff-b731-d51247b9ded1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:55.194945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b92e1-308e-44ce-b15c-287357d2e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:55.195757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b92e1-308e-44ce-b15c-287357d2e137 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:55.195989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b92e1-308e-44ce-b15c-287357d2e137 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:55.196263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b92e1-308e-44ce-b15c-287357d2e137 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/8013af70a957445180db1cdad869b5b7/roles/b06842f53bac40fc821b025679907505` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:55.198454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b92e1-308e-44ce-b15c-287357d2e137 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ff383259a46ada3cebd0e725c6559, user_id=8013af70a957445180db1cdad869b5b7, role_id=b06842f53bac40fc821b025679907505)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:55.200064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b92e1-308e-44ce-b15c-287357d2e137 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:55.308523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 118/234] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:55 2022] PUT /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/8013af70a957445180db1cdad869b5b7/roles/b06842f53bac40fc821b025679907505 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:55.942865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e6eb-04f1-4c66-9d6e-1c3b17100783 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:55.943368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e6eb-04f1-4c66-9d6e-1c3b17100783 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:55.943442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e6eb-04f1-4c66-9d6e-1c3b17100783 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:55.945058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 117/235] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:55.951723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:55.952159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:55.952262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:56.015203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:56.016390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:56.045585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f38c-5c6d-4b64-a8ac-889bff013e7f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:56.046196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f38c-5c6d-4b64-a8ac-889bff013e7f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:56.046667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f38c-5c6d-4b64-a8ac-889bff013e7f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:56.048224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 118/236] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:56.055069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:56.055614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:56.056079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:56.090659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 119/237] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:56.098205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:56.099674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:56.209816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 119/238] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:56.553620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:56.670663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:56.693388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:56.704884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9fc24-445f-4dca-a614-ce1671000aa1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:56.790548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:56.791188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:56.791462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:56.791724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:56.814169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:56.816097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5cc42-aff5-4484-816d-00c45132b274 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:56.817915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:56.820080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:56.820970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:56.821812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 120/239] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:56.836508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:56.884053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:56.884694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:56.884966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:56.885240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:56.886493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:56.891395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:56.893879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 120/240] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:56.906639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:57.029265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a1766-d606-44d0-9cbe-4f6ef11612f8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:57.041146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f5296-652d-44b0-b8b2-22cff4a9d180 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:57.080720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:57.081798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.082272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.082751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.083695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:57.085387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:57.097399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:57.098008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.098283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.098549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.099312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:57.099616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:57.101099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:57.102681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:57.115026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 121/241] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:57.120483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:57.182631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 121/242] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:24:56 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:24:57.244403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967781-bf68-4877-b313-9be9db4013a1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:57.292658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5847-ad8c-4428-ba65-2e6859343d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:57.293348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5847-ad8c-4428-ba65-2e6859343d1c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.293630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5847-ad8c-4428-ba65-2e6859343d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.293947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5847-ad8c-4428-ba65-2e6859343d1c None admin] PATH_INFO: `/v3/users/ab20fc416a3a48d5aa360905b6ce4526` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.310344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5847-ad8c-4428-ba65-2e6859343d1c None admin] RBAC: Authorizing `identity:get_user(user_id=ab20fc416a3a48d5aa360905b6ce4526)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:57.312027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5847-ad8c-4428-ba65-2e6859343d1c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:57.314109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 122/243] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:57 2022] GET /identity/v3/users/ab20fc416a3a48d5aa360905b6ce4526 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:57.319704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:57.354239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:57.443118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d13984-0da2-49fa-804e-0701de992c27 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:57.484656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:57.485635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.486086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.486568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.562836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:57.564684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:57.594065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:57.599832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cc62-9a9f-4294-97cb-de269bd0a2d7 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.600288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cc62-9a9f-4294-97cb-de269bd0a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.600470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cc62-9a9f-4294-97cb-de269bd0a2d7 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.601780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 123/244] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:24:57.607991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192131-72f7-4d53-a1d5-91de1bb44c34 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.608274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192131-72f7-4d53-a1d5-91de1bb44c34 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.608658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192131-72f7-4d53-a1d5-91de1bb44c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.647310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-90192131-72f7-4d53-a1d5-91de1bb44c34 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:57.648914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-90192131-72f7-4d53-a1d5-91de1bb44c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:57.688322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 122/245] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:24:57.692761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:57.719541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:57.739002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 124/246] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:24:57.827451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28d3c-4148-4a80-9e74-44f063d00feb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:57.856833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:57.872729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:57.872729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.872729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.873033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.874153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:57.875658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:57.877848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 123/247] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:57 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:57.882151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07e0f-2e65-4dd6-92c7-5d4374adfb8c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.882747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07e0f-2e65-4dd6-92c7-5d4374adfb8c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.883223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07e0f-2e65-4dd6-92c7-5d4374adfb8c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.883490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:57.885169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 125/248] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:57.891435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a64f-8ad2-4fec-8183-60660a77583d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.891701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a64f-8ad2-4fec-8183-60660a77583d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.891971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a64f-8ad2-4fec-8183-60660a77583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.917764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bea7a64f-8ad2-4fec-8183-60660a77583d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:57.920024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bea7a64f-8ad2-4fec-8183-60660a77583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:58.008383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 126/249] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:58.009683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a635f60-1f7e-4f12-9ca3-34a445e49492 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.009948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a635f60-1f7e-4f12-9ca3-34a445e49492 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.010225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a635f60-1f7e-4f12-9ca3-34a445e49492 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.011484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 127/250] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:24:58.017271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.017558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.017835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.022015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c347-16ab-4a3f-b84c-b4d071345d39 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:58.040573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:24:58.041784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:24:58.076918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:58.077567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.077827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.078103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.078836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] RBAC: Adding query filter params (role.id=fb68dfc34fd24d0784263eac7140a91b, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=ab20fc416a3a48d5aa360905b6ce4526) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:58.079144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:58.080595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:58.092579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 124/251] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:24:57 2022] GET /identity/v3/role_assignments?user.id=ab20fc416a3a48d5aa360905b6ce4526&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=fb68dfc34fd24d0784263eac7140a91b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:58.114661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.187155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 128/252] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:24:58.203364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:58.260225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508acfe-ad91-48e9-af7e-ea4229bab0da None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:58.311368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:58.312018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.312297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.312567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.324578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:58.325978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:58.332029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:58.332974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:58.333823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 125/253] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:24:58.342622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.434243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:58.500012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40526484-1696-440f-be7d-ee20a0a1d9a3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:58.535969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:58.549194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d4dd7-c73f-4658-81dc-4b1b3f575089 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:58.568319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:58.568938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.569237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.569513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.570188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:58.570489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:58.571864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:58.582661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 126/254] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:58.589057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.627279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:58.627926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.628202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.628464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.647214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:58.653275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:58.655827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:24:58.657945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:24:58.665509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 129/255] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:58.676679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.811902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9664-c8c6-476f-a395-e446e96bcc40 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:58.874015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a61ed-3b98-4a13-834f-9458ca7ff5ab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:58.880066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:58.880701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.881026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.881620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:58.888343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] PATH_INFO: `/v3/users/d1508f84211544bf97a2f692b6e6488c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.891690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] RBAC: Authorizing `identity:get_user(user_id=d1508f84211544bf97a2f692b6e6488c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:58.893140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:58.895134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 127/256] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/users/d1508f84211544bf97a2f692b6e6488c => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:58.895905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.955676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:58.956286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:58.956556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:58.956823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:58.957516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:58.957808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:58.959184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:58.985251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 130/257] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:24:58.986438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:58.999222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:59.108183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeab8b-9093-4705-9a9d-c831b660fa04 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.132825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421807-a418-4214-8b06-350fd56ce0dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.182027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.183520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.184484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.185462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.188197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:59.188533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.190507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:59.191123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.191593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.192082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.194462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 131/258] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:59.195646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:59.216078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:24:59.223659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:24:59.224542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:24:59.225387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:24:59.232012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 128/259] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:24:59.234002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:59.268860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:59.394297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467562-5490-495f-831c-7ef75472f579 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.430836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d526-deb3-418d-86f8-65ec69e05d6e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.449586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:59.453723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.454357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.454634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.454903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] PATH_INFO: `/v3/users/8013af70a957445180db1cdad869b5b7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.456152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] RBAC: Authorizing `identity:get_user(user_id=8013af70a957445180db1cdad869b5b7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:59.457618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:59.459200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 132/260] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:59 2022] GET /identity/v3/users/8013af70a957445180db1cdad869b5b7 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:59.459956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:59.495241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.496295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.496578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.496853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/d1508f84211544bf97a2f692b6e6488c/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.500284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ff383259a46ada3cebd0e725c6559, user_id=d1508f84211544bf97a2f692b6e6488c, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:59.502042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:59.586998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 129/261] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:24:59 2022] PUT /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/d1508f84211544bf97a2f692b6e6488c/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:24:59.588152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:59.609079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5526d-35cd-4bb0-9ca4-1c73b081c1ef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.617681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:59.681617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.683091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.683640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.684112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.685622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:24:59.686209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:59.687920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:59.698214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 133/262] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:24:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:24:59.706447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:59.783025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb07a6-8861-4bce-93ae-62df201dc2d6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.886147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.887146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.892478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.893355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.935615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b4569-45bc-4299-a787-3e849fb15e61 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:59.973987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:59.991689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:59.992370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:59.992654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:59.992926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] PATH_INFO: `/v3/users/8013af70a957445180db1cdad869b5b7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:59.995044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] RBAC: Authorizing `identity:get_user(user_id=8013af70a957445180db1cdad869b5b7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:59.998326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.006969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 134/263] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:24:59 2022] GET /identity/v3/users/8013af70a957445180db1cdad869b5b7 => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:00.019750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:00.046887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.050685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.087651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:00.186358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed6123-91e2-46e0-bc5f-3c4ca85d05da None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:00.221056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 130/264] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:00.226332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:00.233962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:00.234592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.234874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.235146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.315385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.317064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.349508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:00.374516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:00.427907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 135/265] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:00.434125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:00.469279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203682c-ce40-45a9-98bc-59caa39d901f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:00.553457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:00.554274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.554535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.554868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.556039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.557575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.560362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44a5ba-ceb5-4722-ad02-21b943a1de66 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:00.567511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 131/266] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:00 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:00.587826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:00.605890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:00.619484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:00.620423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.620866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.627637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.629408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.631117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.633562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 136/267] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:00 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:00.642253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:00.784415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf6a9-c9d2-40b5-a760-159f94aa13f6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:00.797844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1b78-f88b-4614-8898-6e3f9d8e2af2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:00.826618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:00.827558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.828015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.828474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.830184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=8013af70a957445180db1cdad869b5b7) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:00.830923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.832558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14af203-8599-47fb-bb9f-76e2569428c8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.834564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:00.835122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.835406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.835677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.836538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:00.837500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] RBAC: Adding query filter params (role.id=b06842f53bac40fc821b025679907505, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=8013af70a957445180db1cdad869b5b7) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:00.838032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.839613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26e9b-8acb-478c-a7ce-0f132f1cee9e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.845396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 132/268] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:00 2022] GET /identity/v3/role_assignments?user.id=8013af70a957445180db1cdad869b5b7&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:00.857523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 137/269] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:00 2022] GET /identity/v3/role_assignments?user.id=8013af70a957445180db1cdad869b5b7&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=b06842f53bac40fc821b025679907505 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:00.857667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9f6cc-84e1-4747-b64d-211e4be24060 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.857667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9f6cc-84e1-4747-b64d-211e4be24060 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.857667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9f6cc-84e1-4747-b64d-211e4be24060 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.857892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734653-a18c-4b66-b8df-3e0559f10b40 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.857892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734653-a18c-4b66-b8df-3e0559f10b40 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.857892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734653-a18c-4b66-b8df-3e0559f10b40 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.858123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 133/270] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:00.858206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 138/271] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:00.858287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3097d9-48fe-47a4-8b82-fe0510ed4d82 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.858517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3097d9-48fe-47a4-8b82-fe0510ed4d82 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.859199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3097d9-48fe-47a4-8b82-fe0510ed4d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.860755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835525e-f776-488e-a786-b90e6b7fc60d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.861238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835525e-f776-488e-a786-b90e6b7fc60d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.861682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835525e-f776-488e-a786-b90e6b7fc60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.898332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3a3097d9-48fe-47a4-8b82-fe0510ed4d82 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:00.899718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3a3097d9-48fe-47a4-8b82-fe0510ed4d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:00.914693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4835525e-f776-488e-a786-b90e6b7fc60d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:00.915972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4835525e-f776-488e-a786-b90e6b7fc60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:01.024675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 134/272] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:01.058452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:01.069612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba42f8-7861-4633-bb74-1502161052cb None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.070215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba42f8-7861-4633-bb74-1502161052cb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.070652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba42f8-7861-4633-bb74-1502161052cb None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.071064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 139/273] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:01.072393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 135/274] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:01.078902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.079208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.079470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.100135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:01.101390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:01.177840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 140/275] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:01.435384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba42f8-7861-4633-bb74-1502161052cb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.442959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.560087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba42f8-7861-4633-bb74-1502161052cb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:01.573282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8fcd5-474b-4f07-96f2-10df56c72810 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:01.591888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:01.596961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:01.597618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.597892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.598160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.599042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:01.599257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:01.600742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:01.607408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 136/276] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:01.607408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.615405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a25775-361f-4b25-a770-706491779bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:01.616048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25775-361f-4b25-a770-706491779bff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.616296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25775-361f-4b25-a770-706491779bff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.616560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25775-361f-4b25-a770-706491779bff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.629491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a25775-361f-4b25-a770-706491779bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-57a25775-361f-4b25-a770-706491779bff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:01.634389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:01.635262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:01.636067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 141/277] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:01.637787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a25775-361f-4b25-a770-706491779bff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.714863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041936f-ab6b-4741-bf36-5c22c23c68de None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:01.741715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a25775-361f-4b25-a770-706491779bff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:01.747909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:01.748529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.748802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.749066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.759029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:01.764685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:01.765601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:01.766412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 137/278] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:01.770015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.784578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:01.785179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.785490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.785761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.786402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:01.787860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:01.830810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:01.870432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ab9cc-bbf8-42af-a5d5-06a2d81a0818 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:01.901243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 142/279] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:01 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:01.901243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.916029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:01.916766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:01.917091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:01.917635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:01.919344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:01.920770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:01.927895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:01.932026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 138/280] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:01.940077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:01.967705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:02.056184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0a31d-2fac-4614-b140-808cc8eb7b84 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:02.068351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6145-f2dc-4124-b441-fb408a160ed9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:02.098128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:02.101704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:02.102541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.102977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.103399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.104197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:02.104632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:02.106949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:02.114330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:02.114330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.114330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.114639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] PATH_INFO: `/v3/users/9b212b51409847e9a5fb95ced294cc14` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.117826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 143/281] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:02.123597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:02.132841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] RBAC: Authorizing `identity:get_user(user_id=9b212b51409847e9a5fb95ced294cc14)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:02.134358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:02.136338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 139/282] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:01 2022] GET /identity/v3/users/9b212b51409847e9a5fb95ced294cc14 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:02.143036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:02.260945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bc6d6-57fd-46f9-ad91-136a55cb2907 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:02.264060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:02.276747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1eacf-b7e3-48bb-95d9-acef9391cbac None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:02.349192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:02.349981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.350354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.350709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.353028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, user.id=9b212b51409847e9a5fb95ced294cc14, scope.system=all) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:02.354287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:02.356440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:02.364202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 140/283] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Sep 9 11:25:02 2022] GET /identity/v3/role_assignments?user.id=9b212b51409847e9a5fb95ced294cc14&scope.system=all&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:02.364922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da9256-e854-4f53-b909-d2aeb6d80d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:02.365740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9256-e854-4f53-b909-d2aeb6d80d9f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.366020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9256-e854-4f53-b909-d2aeb6d80d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.366294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da9256-e854-4f53-b909-d2aeb6d80d9f None admin] PATH_INFO: `/v3/users/ab20fc416a3a48d5aa360905b6ce4526` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.370205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da9256-e854-4f53-b909-d2aeb6d80d9f None admin] RBAC: Authorizing `identity:get_user(user_id=ab20fc416a3a48d5aa360905b6ce4526)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:02.372880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da9256-e854-4f53-b909-d2aeb6d80d9f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:02.382740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 144/284] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:02 2022] GET /identity/v3/users/ab20fc416a3a48d5aa360905b6ce4526 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:02.390876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:02.451811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:02.518357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ed168-8820-43ba-a0c4-d3f3d9d690b7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:02.564962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa355-411a-48a6-8576-bf745bacc718 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.564962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa355-411a-48a6-8576-bf745bacc718 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.564962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa355-411a-48a6-8576-bf745bacc718 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.564962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 145/285] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:02.569821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.569821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.570146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.596417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:02.597474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.597954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.598429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.599814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:02.601563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:02.603695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 141/286] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:02 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:02.610074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:02.638815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:02.640021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:02.797408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 146/287] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:02.848050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a336d-5408-4e69-a526-253a9647ac13 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:02.875756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:02.925932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:02.926604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:02.926880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:02.927150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/ab20fc416a3a48d5aa360905b6ce4526/roles/fb68dfc34fd24d0784263eac7140a91b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:02.934323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ff383259a46ada3cebd0e725c6559, user_id=ab20fc416a3a48d5aa360905b6ce4526, role_id=fb68dfc34fd24d0784263eac7140a91b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:02.936036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:03.052925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 142/288] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:25:02 2022] PUT /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559/users/ab20fc416a3a48d5aa360905b6ce4526/roles/fb68dfc34fd24d0784263eac7140a91b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:25:03.109088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:03.250956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:03.254824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037c8b-fc7a-4751-88c5-c4c6f2c7618e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:03.302922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:03.303611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:03.303884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:03.304164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:03.315878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:03.320697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:03.322157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:03.322957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 147/289] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:03.328763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:03.465301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7917c-1297-4110-89f8-8dca771c88c7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:03.509915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:03.510514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:03.510786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:03.511046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:03.512442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:03.512757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:03.514128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:03.525511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 143/290] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:03.531315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:03.699945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677f4b-f131-4b57-a483-29831ba4b70b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:03.749495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:03.750123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:03.750399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:03.750666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] PATH_INFO: `/v3/users/d1508f84211544bf97a2f692b6e6488c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:03.751811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] RBAC: Authorizing `identity:get_user(user_id=d1508f84211544bf97a2f692b6e6488c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:03.753284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:03.755158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 148/291] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:03 2022] GET /identity/v3/users/d1508f84211544bf97a2f692b6e6488c => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:03.760775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:03.815343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:03.904607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31de7b-d5ca-45a6-8ebd-10608fb256df None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:03.961290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:03.962345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:03.962825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:03.963315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:04.049535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:04.051367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:04.092007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:04.185535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 144/292] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:04.194371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:04.269170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:04.376142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a02b3a-768b-44af-85a4-edd59e039e94 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:04.431270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40d9f-e31d-4c5c-b1a4-c126b72fe255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:04.431905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40d9f-e31d-4c5c-b1a4-c126b72fe255 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:04.432188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40d9f-e31d-4c5c-b1a4-c126b72fe255 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:04.432463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40d9f-e31d-4c5c-b1a4-c126b72fe255 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:04.433802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb40d9f-e31d-4c5c-b1a4-c126b72fe255 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:04.435270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb40d9f-e31d-4c5c-b1a4-c126b72fe255 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:04.437310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 149/293] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:04 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:04.443164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:04.575672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1f51-815a-4f9b-a132-d86e392f45b9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:04.632319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:04.645902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:04.646527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:04.646940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:04.647222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:04.651465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=d1508f84211544bf97a2f692b6e6488c) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:04.651465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:04.651465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f09cd-b983-4845-bc11-363e5bf9ae27 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:04.656241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 145/294] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:04 2022] GET /identity/v3/role_assignments?user.id=d1508f84211544bf97a2f692b6e6488c&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:05.022847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aca02-c65b-4e33-ad43-f577685c212a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.023084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aca02-c65b-4e33-ad43-f577685c212a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.023365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aca02-c65b-4e33-ad43-f577685c212a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.025099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 150/295] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:05.031778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d03669-03ca-45b6-bc7a-c36533e0cfa1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.032062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d03669-03ca-45b6-bc7a-c36533e0cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.032336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d03669-03ca-45b6-bc7a-c36533e0cfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.053513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b3d03669-03ca-45b6-bc7a-c36533e0cfa1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:05.054726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b3d03669-03ca-45b6-bc7a-c36533e0cfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:05.082844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f78a8-fc81-4aec-b12b-458dd0f21eeb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.083182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f78a8-fc81-4aec-b12b-458dd0f21eeb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.083393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f78a8-fc81-4aec-b12b-458dd0f21eeb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.084882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 151/296] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:05.094923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.095204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.095465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.122184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:05.123405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:05.144249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 146/297] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:05.146015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11785-52d5-4493-8aa7-805aa894e7ac None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.146507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11785-52d5-4493-8aa7-805aa894e7ac None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.146955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11785-52d5-4493-8aa7-805aa894e7ac None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.148674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 147/298] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:05.154885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.155392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.155833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.176923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:05.178451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:05.206473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 152/299] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:05.252934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 148/300] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:05.436846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.468277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.498608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.547190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113ac8b-7ab9-490a-bda6-444e04ed20f9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.568493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.582338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.582968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.583265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.583502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.595263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:05.600140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:05.601073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:05.601930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:05.605928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 153/301] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:05.606968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.619224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019cd16-1f46-4d15-89ac-1f6e38155930 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.654902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c5c5d-0f55-4402-927d-bafc13c3b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.655533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c5c5d-0f55-4402-927d-bafc13c3b701 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.655811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c5c5d-0f55-4402-927d-bafc13c3b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.656079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c5c5d-0f55-4402-927d-bafc13c3b701 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.666341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c5c5d-0f55-4402-927d-bafc13c3b701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5d0c5c5d-0f55-4402-927d-bafc13c3b701 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:05.671399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:05.672482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:05.673626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 149/302] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:05.674400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef3d8c-5b58-49a7-a4f8-c1fa392d58d3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.674400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef3d8c-5b58-49a7-a4f8-c1fa392d58d3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.674400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef3d8c-5b58-49a7-a4f8-c1fa392d58d3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.675418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 150/303] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:05.676092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef3d8c-5b58-49a7-a4f8-c1fa392d58d3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.697256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.715164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ec2e5-4de7-4f6e-9be4-6e1fcfe4f0d2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.747881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.748494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.748770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.749043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.750158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:05.751598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:05.753153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 154/304] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:05.753938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.785252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef3d8c-5b58-49a7-a4f8-c1fa392d58d3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.801368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.818530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.819125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.819397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.819660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.820304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:05.820604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:05.821993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac4d42-7222-4658-be75-b3dac16091da None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:05.830855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 151/305] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:05.832542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.833353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.834051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.852558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:05.853765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596010-68b9-4b87-b91e-b24803ce9812 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.853868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:05.890283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af82be-134b-4279-a950-a08b23759621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.890892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af82be-134b-4279-a950-a08b23759621 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.891192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af82be-134b-4279-a950-a08b23759621 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.891465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af82be-134b-4279-a950-a08b23759621 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.892124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af82be-134b-4279-a950-a08b23759621 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:05.892420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af82be-134b-4279-a950-a08b23759621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:05.893818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af82be-134b-4279-a950-a08b23759621 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:05.907033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 155/306] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:05.907033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af82be-134b-4279-a950-a08b23759621 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.921335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 152/307] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:05.921697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.922294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.018617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af82be-134b-4279-a950-a08b23759621 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.022855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b28d4-3c2c-469f-aa7b-472dec622af9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.032828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:06.055504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.056202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.056538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.056808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] PATH_INFO: `/v3/groups` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.057445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.058868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.059825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.059985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.060146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.060403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] PATH_INFO: `/v3/users/9b212b51409847e9a5fb95ced294cc14` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.061574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] RBAC: Authorizing `identity:get_user(user_id=9b212b51409847e9a5fb95ced294cc14)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.063153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.065145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 153/308] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:05 2022] GET /identity/v3/users/9b212b51409847e9a5fb95ced294cc14 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:06.070351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.134948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 156/309] 10.222.0.64 () {60 vars in 1134 bytes} [Fri Sep 9 11:25:05 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:06.135747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.175633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c40d-65b0-409e-921d-d638367a6773 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.215123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.215944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.216315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.216591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] PATH_INFO: `/v3/users/5871886ec61d4a07bef9ae67ba2188c9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.233141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=5871886ec61d4a07bef9ae67ba2188c9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.234788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.241333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 154/310] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:06 2022] GET /identity/v3/users/5871886ec61d4a07bef9ae67ba2188c9 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:06.241333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.244620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:06.270032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2558-9e37-4f4f-9faf-265dd2dccc83 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.282147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:06.309602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.310269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.310552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.310831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] PATH_INFO: `/v3/system/users/9b212b51409847e9a5fb95ced294cc14/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.312310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b212b51409847e9a5fb95ced294cc14, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.313839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.355018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabad48-79fb-4ef3-958c-566025656cd9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.390430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.391108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.391382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.391649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.401563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:06.406753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:06.407793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 155/311] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:06.408633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.425563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 157/312] 10.222.0.64 () {58 vars in 1334 bytes} [Fri Sep 9 11:25:06 2022] PUT /identity/v3/system/users/9b212b51409847e9a5fb95ced294cc14/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:06.425563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.540708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:06.551350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefbc45-2930-47c2-be9d-a710e0f188b1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.562604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266b64b-4985-49c6-9ccf-af8b2b21f2e6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.602715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.603316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.603591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.603858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.604510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:06.604677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.604788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.606076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.606564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.606840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.606935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.607595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] RBAC: Adding query filter params (role.id=fb68dfc34fd24d0784263eac7140a91b, user.id=5871886ec61d4a07bef9ae67ba2188c9, scope.system=all) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:06.607900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.609361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.621279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 156/313] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Sep 9 11:25:06 2022] GET /identity/v3/role_assignments?user.id=5871886ec61d4a07bef9ae67ba2188c9&scope.system=all&role.id=fb68dfc34fd24d0784263eac7140a91b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:06.621913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 158/314] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:06.626721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.754822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa6e5f-f0b6-42b1-9cc9-c55ad8f336db None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.794661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.795216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.795498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.795774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] PATH_INFO: `/v3/users/ab20fc416a3a48d5aa360905b6ce4526` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.796916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] RBAC: Authorizing `identity:get_user(user_id=ab20fc416a3a48d5aa360905b6ce4526)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.798395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.800363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 157/315] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:06 2022] GET /identity/v3/users/ab20fc416a3a48d5aa360905b6ce4526 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:06.805877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:06.809426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:06.918154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803970-9207-499a-83b2-ccca125b1d05 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.981364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.982448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.982931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.983429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:07.058958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:07.060817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:07.062999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:07.168430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 159/316] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:07.174330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:07.203151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:07.294309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38676e-c695-45fd-90d6-87d6e18783cb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:07.330761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9f530-ecb1-470e-8197-c049c72e6edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:07.331307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9f530-ecb1-470e-8197-c049c72e6edb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:07.331581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9f530-ecb1-470e-8197-c049c72e6edb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:07.331845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9f530-ecb1-470e-8197-c049c72e6edb None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:07.332959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9f530-ecb1-470e-8197-c049c72e6edb None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:07.334431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9f530-ecb1-470e-8197-c049c72e6edb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:07.336231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 158/317] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:07 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:07.343094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:07.456242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9f3f6-5837-4c74-b04e-900d861ac880 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:07.458348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:07.494496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:07.495094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:07.495401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:07.495831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:07.496977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] RBAC: Adding query filter params (role.id=fb68dfc34fd24d0784263eac7140a91b, scope.project.id=9b0ff383259a46ada3cebd0e725c6559, user.id=ab20fc416a3a48d5aa360905b6ce4526) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:07.497310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:07.498765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392de5-747a-4ba8-bd42-231f96e79d21 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:07.505259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 160/318] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:07 2022] GET /identity/v3/role_assignments?user.id=ab20fc416a3a48d5aa360905b6ce4526&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=fb68dfc34fd24d0784263eac7140a91b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:08.376952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09174-6992-485a-8a1c-3b646472cbe6 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.377523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09174-6992-485a-8a1c-3b646472cbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.377523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09174-6992-485a-8a1c-3b646472cbe6 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.379031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 159/319] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:08.384291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.384703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.384868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.403984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:08.405175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:08.472816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 161/320] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:08.744198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49fe60-0f1d-4995-9e5e-71407a83f77d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.744476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49fe60-0f1d-4995-9e5e-71407a83f77d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.744742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49fe60-0f1d-4995-9e5e-71407a83f77d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.745522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:08.746528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 160/321] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:08.752220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232eb3a-d215-4530-835b-c9650d804772 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.752499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232eb3a-d215-4530-835b-c9650d804772 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.752763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232eb3a-d215-4530-835b-c9650d804772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.771931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0232eb3a-d215-4530-835b-c9650d804772 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:08.773105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0232eb3a-d215-4530-835b-c9650d804772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:08.846911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 161/322] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:08.850416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:08.853301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f3ab-1cbb-40ff-a2d9-878241521922 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.853584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f3ab-1cbb-40ff-a2d9-878241521922 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.853851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f3ab-1cbb-40ff-a2d9-878241521922 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.855385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 162/323] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:08.857045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8ddab-3368-4c8d-94c4-dbd649851bae None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:08.861352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.861635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.861901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.883451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:08.884898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:08.893524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:08.893805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:08.894088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:08.894356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:08.895448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:08.896884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:08.898647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 162/324] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:08.904700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:08.906713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:08.957964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 163/325] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:09.013759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8ec0f-0a67-4093-ad81-46418da8255e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.047740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.048609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.049110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.049599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] PATH_INFO: `/v3/groups` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.050401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:09.052015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:09.118843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.161734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 163/326] 10.222.0.64 () {60 vars in 1134 bytes} [Fri Sep 9 11:25:08 2022] POST /identity/v3/groups => generated 226 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:25:09.231128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13546e-def3-4339-909d-47eacdd1e5c9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.236007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.264795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:09.269684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.270344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.274049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.274049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.282822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:09.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:09.288731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:09.289571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 164/327] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:09.295136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.312937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:09.357417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9de29d-3461-45b2-a61e-8fc580f19f3d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.399666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.400409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.400637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.400907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.411596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e7b5-bc40-4cf1-b95c-bfb075a95491 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.414405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:09.421131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:09.422266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:09.423261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 164/328] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:09.429145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.458803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.459670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.460089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.460496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.461320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:09.461864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:09.463573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:09.474762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 165/329] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:09.482264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.534153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:09.560115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45556e2-2c4f-4966-845f-76e455d3313c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.577018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:09.603404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.604008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.604837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.605152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.605755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:09.606050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:09.607442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:09.621462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cadb3e-aa98-4adf-ad03-f8f27e6e35b8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.621660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 165/330] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:09.624448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.674269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.675413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.675865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.676458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] PATH_INFO: `/v3/users/9b212b51409847e9a5fb95ced294cc14` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.678035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] RBAC: Authorizing `identity:get_user(user_id=9b212b51409847e9a5fb95ced294cc14)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:09.679650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:09.681692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 166/331] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/users/9b212b51409847e9a5fb95ced294cc14 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:09.688257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.747445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f41189-3ca1-4fd1-94bb-18109ceb8429 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.793022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.794024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.794501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.794969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] PATH_INFO: `/v3/users/5871886ec61d4a07bef9ae67ba2188c9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.796326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] RBAC: Authorizing `identity:get_user(user_id=5871886ec61d4a07bef9ae67ba2188c9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:09.798097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:09.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 166/332] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/users/5871886ec61d4a07bef9ae67ba2188c9 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:09.805396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:09.818051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b716f2e-7ed3-49bc-842a-08e4bdbb9405 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:09.826727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:09.858554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:09.860916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:09.860916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:09.860916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:09.860916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] RBAC: Adding query filter params (role.id=1b11b6b4c5ef4fb99f930f82af2a2421, user.id=9b212b51409847e9a5fb95ced294cc14, scope.system=all) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:09.860916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:09.863508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36369e68-8a0a-46a5-b912-6a7a9b7eab63 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:09.876488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 167/333] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Sep 9 11:25:09 2022] GET /identity/v3/role_assignments?user.id=9b212b51409847e9a5fb95ced294cc14&scope.system=all&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:10.020356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7ba28-440d-4ebd-a3e6-96d07344cdfe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:10.067076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa1828-eefd-4493-bda9-d15db06c2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:10.067651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1828-eefd-4493-bda9-d15db06c2b25 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:10.067934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1828-eefd-4493-bda9-d15db06c2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:10.068207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1828-eefd-4493-bda9-d15db06c2b25 None admin] PATH_INFO: `/v3/system/users/5871886ec61d4a07bef9ae67ba2188c9/roles/fb68dfc34fd24d0784263eac7140a91b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:10.070179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa1828-eefd-4493-bda9-d15db06c2b25 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5871886ec61d4a07bef9ae67ba2188c9, role_id=fb68dfc34fd24d0784263eac7140a91b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:10.071587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa1828-eefd-4493-bda9-d15db06c2b25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:10.143452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 167/334] 10.222.0.64 () {58 vars in 1334 bytes} [Fri Sep 9 11:25:09 2022] PUT /identity/v3/system/users/5871886ec61d4a07bef9ae67ba2188c9/roles/fb68dfc34fd24d0784263eac7140a91b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:25:11.779650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21ef7-614b-47e5-b0c5-0523593cc6a7 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:11.780583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21ef7-614b-47e5-b0c5-0523593cc6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:11.781054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21ef7-614b-47e5-b0c5-0523593cc6a7 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:11.783013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 168/335] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:11.789570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d054d-d9bb-4e75-b4af-81d3ee0504fe None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:11.790577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d054d-d9bb-4e75-b4af-81d3ee0504fe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:11.791063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d054d-d9bb-4e75-b4af-81d3ee0504fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:11.811381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f49d054d-d9bb-4e75-b4af-81d3ee0504fe None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:11.812900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f49d054d-d9bb-4e75-b4af-81d3ee0504fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:11.887556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 168/336] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:12.033928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260dc21-06b5-4ade-8c55-17ed51b36988 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.034263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260dc21-06b5-4ade-8c55-17ed51b36988 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.034495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260dc21-06b5-4ade-8c55-17ed51b36988 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:12.036090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 169/337] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:12.041920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.042445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.043028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:12.066190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:12.067792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:12.070222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:12.142115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 169/338] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:12.375801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260dc21-06b5-4ade-8c55-17ed51b36988 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:12.378812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:12.501549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260dc21-06b5-4ade-8c55-17ed51b36988 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:12.537919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:12.538915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.539395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.539861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:12.551260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:12.556807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:12.557861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:12.558903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:12.565309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 170/339] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:12.568029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:12.638850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:12.775615 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:12.790196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7890e-c67c-48dd-8c98-9cf426422728 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:12.841873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053fed-2de3-4942-a1e2-d771c672e64c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:12.857558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:12.858166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.858439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.858703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:12.859365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:12.859657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:12.861043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63944-4ba6-4f8f-9daf-39da6e15a8ec None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:12.872809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:12.881401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 170/340] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:12.885602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204f80-f7e2-4ee9-8eb7-283c8e761dc9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.886397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204f80-f7e2-4ee9-8eb7-283c8e761dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.886983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204f80-f7e2-4ee9-8eb7-283c8e761dc9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:12.888431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 171/341] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:12.890391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc204f80-f7e2-4ee9-8eb7-283c8e761dc9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:12.932735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4966-6b03-4e27-95d6-2dfee182f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:12.933683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4966-6b03-4e27-95d6-2dfee182f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.934133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4966-6b03-4e27-95d6-2dfee182f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.934584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4966-6b03-4e27-95d6-2dfee182f6c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:12.964469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc4966-6b03-4e27-95d6-2dfee182f6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-92cc4966-6b03-4e27-95d6-2dfee182f6c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:12.969825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:12.970721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:12.971541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 171/342] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:12.976995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:12.977295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:12.977663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:13.004622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:13.005823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:13.055890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc204f80-f7e2-4ee9-8eb7-283c8e761dc9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:13.132639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:13.133676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:13.134141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:13.135838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:13.141286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 172/343] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:13.145540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:13.264963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:13.317712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:13.325554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:13.330785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:13.397129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01066b9-e7d9-49b1-b7ea-9b6ac67a007d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:13.441275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:13.441891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:13.442164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:13.442432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:13.443093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:13.443386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:13.444760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:13.458097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 173/344] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:13.473109 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:13.568373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 172/345] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:13.574597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:13.632582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0f7ea-da25-49a9-9aa4-bc4fca0d654a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:13.652777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:13.683964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d8304-deb2-47e7-87cc-756454f7df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:13.685356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8304-deb2-47e7-87cc-756454f7df66 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:13.686024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8304-deb2-47e7-87cc-756454f7df66 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:13.686720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8304-deb2-47e7-87cc-756454f7df66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:13.785438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d8304-deb2-47e7-87cc-756454f7df66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:13.787940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d8304-deb2-47e7-87cc-756454f7df66 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:13.823723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5127f4-29b1-40ad-8afb-456409796995 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:13.831252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:13.873353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:13.874343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:13.874818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:13.875431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:13.876792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:13.879035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:13.881622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 173/346] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:13 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:13.883013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:13.964854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 174/347] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:13.966365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76052c54-0ddf-46c0-9a98-9a4ec37d4ccc None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:13.966637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76052c54-0ddf-46c0-9a98-9a4ec37d4ccc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:13.966909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76052c54-0ddf-46c0-9a98-9a4ec37d4ccc None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:13.968160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 175/348] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:13.968847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76052c54-0ddf-46c0-9a98-9a4ec37d4ccc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:13.990344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.032182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653317cb-4c3d-48b8-b0d6-b12d6631891a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.074059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38137662-4582-42b1-aa26-913fe8ddfb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.074973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38137662-4582-42b1-aa26-913fe8ddfb3e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.075373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38137662-4582-42b1-aa26-913fe8ddfb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.075743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38137662-4582-42b1-aa26-913fe8ddfb3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.092373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38137662-4582-42b1-aa26-913fe8ddfb3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-38137662-4582-42b1-aa26-913fe8ddfb3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:14.098207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:14.099254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:14.100454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 174/349] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:14.101370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938dd8-8b42-4acd-8fef-ee962689d6f2 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.101370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938dd8-8b42-4acd-8fef-ee962689d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.101538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938dd8-8b42-4acd-8fef-ee962689d6f2 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.102780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 175/350] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:14.103300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938dd8-8b42-4acd-8fef-ee962689d6f2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:14.115077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76052c54-0ddf-46c0-9a98-9a4ec37d4ccc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.142590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.162495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01e185-658f-42f8-9f48-9d87b868d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.163437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01e185-658f-42f8-9f48-9d87b868d694 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.164367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01e185-658f-42f8-9f48-9d87b868d694 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.164772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01e185-658f-42f8-9f48-9d87b868d694 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.180592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01e185-658f-42f8-9f48-9d87b868d694 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:14.182517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01e185-658f-42f8-9f48-9d87b868d694 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:14.183997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 176/351] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:13 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:14.185166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.185530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.185952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.208872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:14.210440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:14.238941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938dd8-8b42-4acd-8fef-ee962689d6f2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.282510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cba31b-1b0d-4f8b-b23a-f0ea7985062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.283149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba31b-1b0d-4f8b-b23a-f0ea7985062b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.283426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba31b-1b0d-4f8b-b23a-f0ea7985062b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.283694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba31b-1b0d-4f8b-b23a-f0ea7985062b None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.285306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba31b-1b0d-4f8b-b23a-f0ea7985062b None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:14.286750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cba31b-1b0d-4f8b-b23a-f0ea7985062b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:14.288367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 176/352] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:14 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:14.291383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.291383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.291383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.305971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 177/353] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:14.307520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:14.318898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:14.320085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:14.325293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.432038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 177/354] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:14.433313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:14.468467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.471841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4228-7cb8-43f5-8f81-8fe0394bf990 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.550744 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.551375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.551669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.551923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.552590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:14.552890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:14.554307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:14.556293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a93311-36f7-45e6-9c0c-d95037259f67 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.565049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 178/355] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:14.566829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:14.601132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.601684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.601963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.602869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.602970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=a419c813a6bf4516b4bfadac726c8046) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:14.603422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:14.605779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed524b-685c-4fb4-83cd-cc77edac5d38 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:14.622460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 178/356] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:14 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:14.624120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f3406-f754-4eaa-a1c5-b90d71f7b2e9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.624265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f3406-f754-4eaa-a1c5-b90d71f7b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.624441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f3406-f754-4eaa-a1c5-b90d71f7b2e9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.625797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 179/357] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:14.633879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f3406-f754-4eaa-a1c5-b90d71f7b2e9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:14.667062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.711377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e7c25-a42c-4698-b0ac-9f88d83e8080 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.750062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.754723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.755723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.755995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.756526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.757698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:14.759196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:14.761962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 179/358] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:14 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:14.762845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:14.763441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f3406-f754-4eaa-a1c5-b90d71f7b2e9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.813008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.813668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.814233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.814502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.904721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927b83a-53b8-4b3f-b579-120dc1b848a0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:14.906249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:14.908704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:14.953856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dd5ad-159b-454d-8097-8cd94f6b2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:14.954698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dd5ad-159b-454d-8097-8cd94f6b2bdd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.954979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dd5ad-159b-454d-8097-8cd94f6b2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.955251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dd5ad-159b-454d-8097-8cd94f6b2bdd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:14.963401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:14.967715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dd5ad-159b-454d-8097-8cd94f6b2bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a70dd5ad-159b-454d-8097-8cd94f6b2bdd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:14.973135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:14.979627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 180/359] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:14.980495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:14.981394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:14.981394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.001343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:15.005335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:15.035375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.048783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 180/360] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:15.050115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.092024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 181/361] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:15.093166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.193901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b3f75-ed61-4e27-b00b-be2702a25fac None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.228492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087c9a3-b7f9-45b2-8797-048c44b7fd9a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.239933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.241240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.241827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.242388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.243273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=b06842f53bac40fc821b025679907505, scope.project.id=a419c813a6bf4516b4bfadac726c8046) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:15.244541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:15.246902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:15.254246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 181/362] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=b06842f53bac40fc821b025679907505 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:15.255873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.259151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.269094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.272342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.272342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.272342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.290818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:15.296419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:15.297392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:15.298215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:15.302051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 182/363] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:15.303093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.325195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.383073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bc242-d162-490d-a9ca-6ccad760e8e8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.423919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.424534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.424814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.425083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.426342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:15.426342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:15.427505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:15.439514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 182/364] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:15.440600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.510588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69495f-4046-498a-b553-352dd43b930e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.556719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.557479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.557762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.558033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.559172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:15.560592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:15.562943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 183/365] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:15.568032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.573144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3060db-c857-4b24-9b9a-98f91f47106e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.592954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.616506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.617167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.617470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.617738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.618395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:15.618764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:15.620438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:15.632920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 183/366] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:15.634038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.663138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.727850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e841f2-77c0-46f7-a516-6963298772e8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.777648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.778414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.778577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.778938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.793810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:15.798674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:15.799574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:15.800438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 184/367] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:15.801112 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.810993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c580-64d3-47fa-b642-3965921e9209 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.848120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.849042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.849519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.849986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] PATH_INFO: `/v3/users/5871886ec61d4a07bef9ae67ba2188c9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.851299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] RBAC: Authorizing `identity:get_user(user_id=5871886ec61d4a07bef9ae67ba2188c9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:15.852944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:15.855126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 184/368] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/users/5871886ec61d4a07bef9ae67ba2188c9 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:15.856151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.908364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.914428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5433a-6e59-453d-b60f-f10651a6f303 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:15.933345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:15.967654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:15.968295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:15.968828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:15.968828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:15.969934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:15.971866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:15.977290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 185/369] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:15.979003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:15.982824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e300-d6fc-428e-bfbc-aa1907c7ff90 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:16.027626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:16.028286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:16.028538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:16.028809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:16.111012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8849-e40c-4ed9-b04b-df90eff992d9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:16.112389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:16.114017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:16.156626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:16.157244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:16.157550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:16.157820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:16.158747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:16.159044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:16.161355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:16.172606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 186/370] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:16.173751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:16.174981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:16.235139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:16.241771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 185/371] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:16.242699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:16.305275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f476d8-cdd6-49dd-8bde-7cf886250ded None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:16.345103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:16.346771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:16.347422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:16.348008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:16.349021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] RBAC: Adding query filter params (role.id=fb68dfc34fd24d0784263eac7140a91b, user.id=5871886ec61d4a07bef9ae67ba2188c9, scope.system=all) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:16.349655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:16.351285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:16.356612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531974-4390-4ab7-9fa2-7865ab557e25 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:16.367158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 187/372] 10.222.0.64 () {56 vars in 1308 bytes} [Fri Sep 9 11:25:16 2022] GET /identity/v3/role_assignments?user.id=5871886ec61d4a07bef9ae67ba2188c9&scope.system=all&role.id=fb68dfc34fd24d0784263eac7140a91b => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:16.368446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:16.398823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:16.399473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:16.399778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:16.400108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:16.401359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=9b0ff383259a46ada3cebd0e725c6559) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:16.401671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:16.403453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:16.410607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 186/373] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:16 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:16.411517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:16.445442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:16.605318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf8f5-dc84-45b3-8dd1-ae00b39cbc33 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:16.612196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:16.678137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446e46-adb3-48b2-9703-a95f318dc35c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:16.692020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:16.692646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:16.692922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:16.693193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:16.755165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:16.755814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:16.756091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:16.756367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:16.760367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:16.761980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:16.763929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 187/374] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:16 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:16.770363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:16.836058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:16.838323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:16.904292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:16.943447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94242ab5-e18f-4808-bd58-93c37bbe4502 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:17.008496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:17.010313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.010596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.010958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.011480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 188/375] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:17.012061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:17.013544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:17.016045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:17.018974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 188/376] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:16 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:17.021033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:17.021783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:17.185107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6990f-8cf8-4069-89df-f9a1d0025d5f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:17.214978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356b37-a1d1-44cf-a33d-38f801832ed3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:17.251070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:17.251683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.251963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.252231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.252955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=b06842f53bac40fc821b025679907505, scope.project.id=9b0ff383259a46ada3cebd0e725c6559) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:17.253277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:17.254845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0662c33-b510-419a-9c65-a190e26e6665 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:17.272937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 189/377] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:17 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=b06842f53bac40fc821b025679907505 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:17.274253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f364b-9595-4db4-b60c-8603a7df6b64 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.274584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f364b-9595-4db4-b60c-8603a7df6b64 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.275093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f364b-9595-4db4-b60c-8603a7df6b64 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.277002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 190/378] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:17.283151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.283456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.283698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.291091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:17.292125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.292412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.292687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] PATH_INFO: `/v3/projects/ff309e01cdfe4cb7b8cf92847353f141` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.297273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] RBAC: Authorizing `identity:get_project(project_id=ff309e01cdfe4cb7b8cf92847353f141)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:17.298846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:17.305048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 189/379] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:17 2022] GET /identity/v3/projects/ff309e01cdfe4cb7b8cf92847353f141 => generated 344 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:17.307849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:17.309206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:17.310457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:17.318023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:17.429260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:17.452637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 191/380] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:17.477156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595a96b-bc53-494e-8e94-f5e0d0d9f5aa None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:17.521854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:17.522888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.523374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.523857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] PATH_INFO: `/v3/groups/b08f6465515248d89c29be1424c5ac1e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.531101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] RBAC: Authorizing `identity:get_group(group_id=b08f6465515248d89c29be1424c5ac1e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:17.532828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:17.535077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 190/381] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:17 2022] GET /identity/v3/groups/b08f6465515248d89c29be1424c5ac1e => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:17.541795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:17.654739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194c91-f94e-4389-923c-c24708e1c228 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:17.693845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:17.694446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.694722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.694988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.695711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] RBAC: Adding query filter params (group.id=b08f6465515248d89c29be1424c5ac1e, role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=ff309e01cdfe4cb7b8cf92847353f141) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:17.696012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:17.698505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63324d13-1498-4e51-9a59-de99d9212df4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:17.704375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 192/382] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:17 2022] GET /identity/v3/role_assignments?group.id=b08f6465515248d89c29be1424c5ac1e&scope.project.id=ff309e01cdfe4cb7b8cf92847353f141&role.id=137cd8e0839747668eef67677a0171b5 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:17.780645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:17.903866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161e07-7bf5-4171-95d8-3fad0ac6fc85 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:17.950277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:17.950918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.951190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.951456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.958569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:17.965032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa38bce-d55e-4310-8127-d9991800492a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.965535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa38bce-d55e-4310-8127-d9991800492a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.965610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa38bce-d55e-4310-8127-d9991800492a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.968297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 193/383] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:17.969112 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:17.972490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:17.972766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:17.973031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:17.974248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:17.978198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:17.979044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 191/384] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:17.984281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:17.985054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:17.996713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:17.997974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:18.124290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 194/385] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:18.137760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198577-33b8-4bb2-a4f3-027a8a8670ad None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:18.174727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:18.175339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:18.175616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:18.175888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:18.176551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:18.176849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:18.178244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:18.190974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 192/386] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:18.197124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:18.325026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f359e-fca0-4ee9-b9c7-6e68a0b8e9a6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:18.362930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:18.363630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:18.363903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:18.364169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:18.365341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:18.366783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:18.369438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 195/387] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:18 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:18.377298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:18.444599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:18.491352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14d8f-3e17-4c92-a866-3a9b5cab5e75 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:18.532529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:18.533163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:18.533465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:18.533731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:18.537947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:18.539634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:18.542916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 193/388] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:18 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:18.548419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:18.551815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:18.632061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:18.706026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031b89-3b08-4043-b3a4-23196adff524 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:18.782362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5f79f-fe2a-4f84-a5a4-8e8cce732249 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:18.786549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:18.787217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:18.787494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:18.787766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:18.794564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a419c813a6bf4516b4bfadac726c8046, group_id=ef2f2687b64d42f5bc52a48493ca046c, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:18.796009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:18.812264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:18.822651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:18.823282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:18.823555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:18.823819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:18.835852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:18.841127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:18.842108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:18.842943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 194/389] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:18.848161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:18.892324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 196/390] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Sep 9 11:25:18 2022] PUT /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:18.980713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140c91-308c-430b-a258-ce8e821afd1b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:19.018958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:19.020059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.020537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.021000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.021932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:19.022441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:19.024082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:19.034936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 195/391] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:19.040335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:19.112078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:19.156246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802a190-d37b-4182-b3dc-a0d6d40a82e1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:19.194123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:19.194804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.195142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.195421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.197404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:19.198839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:19.200711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 197/392] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:19 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:19.206031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:19.267104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:19.331876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fc783-b3b0-4a10-8d35-8cf675ac5fd2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:19.377306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8b05c-9d44-4519-9377-d9c4439a9228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:19.377939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b05c-9d44-4519-9377-d9c4439a9228 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.378214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b05c-9d44-4519-9377-d9c4439a9228 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.378483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8b05c-9d44-4519-9377-d9c4439a9228 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.379654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b05c-9d44-4519-9377-d9c4439a9228 None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:19.381140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8b05c-9d44-4519-9377-d9c4439a9228 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:19.383170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 196/393] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:19 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:19.389586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:19.531397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2003d6-cb74-445e-acc1-47ba4d891d55 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:19.563218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:19.569753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600844c-cf84-4d7b-9524-f3b7f2bc3990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:19.570417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600844c-cf84-4d7b-9524-f3b7f2bc3990 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.570688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600844c-cf84-4d7b-9524-f3b7f2bc3990 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.570961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600844c-cf84-4d7b-9524-f3b7f2bc3990 None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/b06842f53bac40fc821b025679907505` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.573833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600844c-cf84-4d7b-9524-f3b7f2bc3990 None admin] RBAC: Authorizing `identity:create_grant(project_id=a419c813a6bf4516b4bfadac726c8046, group_id=ef2f2687b64d42f5bc52a48493ca046c, role_id=b06842f53bac40fc821b025679907505)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:19.575370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600844c-cf84-4d7b-9524-f3b7f2bc3990 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:19.681908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 198/394] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Sep 9 11:25:19 2022] PUT /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/b06842f53bac40fc821b025679907505 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:19.950775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66702fbd-4c46-4fef-bb4c-fae98ae1aba8 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.951106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66702fbd-4c46-4fef-bb4c-fae98ae1aba8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.951340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66702fbd-4c46-4fef-bb4c-fae98ae1aba8 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.952926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 197/395] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:19.958824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d12c-a05c-446c-b532-7032529842ba None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.959117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d12c-a05c-446c-b532-7032529842ba None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.959366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d12c-a05c-446c-b532-7032529842ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.979465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2278d12c-a05c-446c-b532-7032529842ba None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:19.980661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2278d12c-a05c-446c-b532-7032529842ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:19.989286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302752-2e59-46df-9262-e467daf71dc4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.989604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302752-2e59-46df-9262-e467daf71dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.989829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302752-2e59-46df-9262-e467daf71dc4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:19.992104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 198/396] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:19.997893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:19.998514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:19.998987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.029876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:20.031070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:20.079826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 199/397] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:20.115295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 199/398] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:20.403084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d12c-a05c-446c-b532-7032529842ba None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:20.447167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:20.533323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d12c-a05c-446c-b532-7032529842ba None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:20.548506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:20.578051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:20.614929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:20.615583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:20.615916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:20.616182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.641874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:20.648549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:20.649687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:20.650487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 200/399] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:20.667292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:20.673737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0315e-30c5-4a1b-968b-bac7437f68ff None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:20.725856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ced16-6e12-465c-9c62-c10797b02e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:20.726490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ced16-6e12-465c-9c62-c10797b02e1b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:20.726762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ced16-6e12-465c-9c62-c10797b02e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:20.727532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ced16-6e12-465c-9c62-c10797b02e1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.739382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ced16-6e12-465c-9c62-c10797b02e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ba3ced16-6e12-465c-9c62-c10797b02e1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:20.744553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:20.745483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:20.746267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:20.750447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 200/400] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:20.751702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331dc3-9776-4a68-a8cb-4bb056030617 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:20.751979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331dc3-9776-4a68-a8cb-4bb056030617 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:20.752252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b331dc3-9776-4a68-a8cb-4bb056030617 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.753540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 201/401] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:20.760214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b331dc3-9776-4a68-a8cb-4bb056030617 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:20.805320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b3b9-ad3c-410d-9bc5-319e1de27f25 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:20.853337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:20.854229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:20.854507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:20.854773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.855603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:20.855906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:20.858021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939f0d-8cef-4dab-bbcf-03eadea19933 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:20.871264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 201/402] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:20.874335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:20.874629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:20.874904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.882238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b331dc3-9776-4a68-a8cb-4bb056030617 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:20.891617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:20.894739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:20.895945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:20.922447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:20.923110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:20.923396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:20.923657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:20.924444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:20.924750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:20.926280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:20.937411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 202/403] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:20.938282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:20.943039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:20.982436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 202/404] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:20.986165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.119406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d74714-f143-489e-9ccf-0d95d30b80e3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.164559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e57a0-083b-4351-9537-f7b48cc4e25b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.202709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.203346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.203623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.203898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.205163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.208512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.217300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.218009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.218295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.218569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.219400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 203/405] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:20 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:21.220267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.221182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.222645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.225386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 203/406] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:20 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:21.231963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.293642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:21.312600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:21.371805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854453f7-8040-4024-92fa-e14c548cd9c7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.382455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439f784-3c83-4da6-828a-2fe2f5d668a2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.412363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.413383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.413887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.414857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.416201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.417853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.420019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 204/407] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:21 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:21.421021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.436118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.436749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.437026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.437526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.438909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.441144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.443757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 204/408] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:21 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:21.444505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.560721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825daf-d111-4b59-846c-226b25cff120 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.563705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:21.569282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f552dc-b727-4123-887c-fad9e6ae38e1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.579882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:21.610106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5301f3a-0d5b-4cd3-adb2-67981d657cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.612837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5301f3a-0d5b-4cd3-adb2-67981d657cb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.613392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5301f3a-0d5b-4cd3-adb2-67981d657cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.614384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.615005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.615272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.615538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.616138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5301f3a-0d5b-4cd3-adb2-67981d657cb5 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/b06842f53bac40fc821b025679907505` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.618522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5301f3a-0d5b-4cd3-adb2-67981d657cb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ff383259a46ada3cebd0e725c6559, group_id=ef2f2687b64d42f5bc52a48493ca046c, role_id=b06842f53bac40fc821b025679907505)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.619980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5301f3a-0d5b-4cd3-adb2-67981d657cb5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.629735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:21.635940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:21.637057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 205/409] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:21.638055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.735396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2c25-a88a-42c2-a692-e312d2b9c19a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.741273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 205/410] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Sep 9 11:25:21 2022] PUT /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/b06842f53bac40fc821b025679907505 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:21.741273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff787ba-970f-4ce6-b783-807f3e29c58e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.741273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff787ba-970f-4ce6-b783-807f3e29c58e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.741273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff787ba-970f-4ce6-b783-807f3e29c58e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.741273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 206/411] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:21.741273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff787ba-970f-4ce6-b783-807f3e29c58e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:21.781141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a8006-05e1-44a2-abd9-9acf9e8fb533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.782118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a8006-05e1-44a2-abd9-9acf9e8fb533 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.782543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a8006-05e1-44a2-abd9-9acf9e8fb533 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.782948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a8006-05e1-44a2-abd9-9acf9e8fb533 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.785103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a8006-05e1-44a2-abd9-9acf9e8fb533 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ff383259a46ada3cebd0e725c6559, group_id=ef2f2687b64d42f5bc52a48493ca046c, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.786832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a8006-05e1-44a2-abd9-9acf9e8fb533 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.869195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 206/412] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Sep 9 11:25:21 2022] PUT /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559/groups/ef2f2687b64d42f5bc52a48493ca046c/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:21.870105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff787ba-970f-4ce6-b783-807f3e29c58e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:21.873160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.873758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.875469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.920759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:21.922310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:21.955074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:21.955940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:21.956073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:21.956269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:21.956934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:21.957246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:21.960193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:21.964129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:21.974794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 207/413] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:21.981181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:22.023394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:22.036536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 207/414] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:22.104380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad238141-ea6d-4636-ae8d-0bf4acaf0eda None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:22.139075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:22.139669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.139951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.140229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] PATH_INFO: `/v3/groups/b08f6465515248d89c29be1424c5ac1e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.141433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] RBAC: Authorizing `identity:get_group(group_id=b08f6465515248d89c29be1424c5ac1e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:22.142913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:22.144779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 208/415] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:21 2022] GET /identity/v3/groups/b08f6465515248d89c29be1424c5ac1e => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:22.150214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:22.255818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c385f0-a897-4f9f-adcc-bad7a6e92322 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:22.298159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:22.299185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.299640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.300094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] PATH_INFO: `/v3/projects/ff309e01cdfe4cb7b8cf92847353f141` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.301449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] RBAC: Authorizing `identity:get_project(project_id=ff309e01cdfe4cb7b8cf92847353f141)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:22.303138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:22.305398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 208/416] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:22 2022] GET /identity/v3/projects/ff309e01cdfe4cb7b8cf92847353f141 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:22.313355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:22.356793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:22.383526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:22.468454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:22.474042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538095bf-e80f-4d93-8d33-5b0ba2a61755 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:22.484486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31fa3d-a574-434f-a535-6395c5b7f129 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:22.522998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:22.524314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.524590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.524907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] PATH_INFO: `/v3/projects/ff309e01cdfe4cb7b8cf92847353f141/groups/b08f6465515248d89c29be1424c5ac1e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.526546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d2d1-d102-4bdc-b3d2-198a6342243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:22.526821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff309e01cdfe4cb7b8cf92847353f141, group_id=b08f6465515248d89c29be1424c5ac1e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:22.527592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d2d1-d102-4bdc-b3d2-198a6342243e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.528066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d2d1-d102-4bdc-b3d2-198a6342243e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.528254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:22.528715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d2d1-d102-4bdc-b3d2-198a6342243e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.540754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d2d1-d102-4bdc-b3d2-198a6342243e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b865d2d1-d102-4bdc-b3d2-198a6342243e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:22.545798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:22.546699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:22.547505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 209/417] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:22.553338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde978a-66e5-4feb-a565-6bd2eddf0aee None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.553338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde978a-66e5-4feb-a565-6bd2eddf0aee None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.553338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde978a-66e5-4feb-a565-6bd2eddf0aee None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.554682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 210/418] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:22.556365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.556650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.556923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.576055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:22.577285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:22.603164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 209/419] 10.222.0.64 () {58 vars in 1442 bytes} [Fri Sep 9 11:25:22 2022] PUT /identity/v3/projects/ff309e01cdfe4cb7b8cf92847353f141/groups/b08f6465515248d89c29be1424c5ac1e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:22.604349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:22.706241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 211/420] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:22.822496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b5df-9fd3-47ef-93a5-a5bc35262bf0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:22.859144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:22.859748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:22.860020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:22.860285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:22.860939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:22.861252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:22.862616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:22.871378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 210/421] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:22.879273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:22.901578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.023174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f91e-86aa-4df5-9d10-de4e584d6a9c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:23.034097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:23.061903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:23.062505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:23.062840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:23.063251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:23.077180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.143684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:23.145191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:23.161035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.225242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fedd3-5b6b-4abe-b87a-26a1ff710bbb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:23.258507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 212/422] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:23.260354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:23.288770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:23.289691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:23.291618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:23.291907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:23.315421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:23.320852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:23.321777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:23.322692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:23.338177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 211/423] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:23.339062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:23.437547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761bb0-86f7-4d7a-95ea-0f5bd5887a61 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:23.461798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.504616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:23.505259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:23.505534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:23.505636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.505832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:23.507988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:23.509732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:23.513268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 213/424] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:23 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:23.517099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:23.531743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c8e8-a9d8-46d8-80a1-df087c245529 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:23.612426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:23.612949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:23.613234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:23.613505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:23.614255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:23.614552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:23.615938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:23.634765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 212/425] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:23.639578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:23.667226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e980a4-db1d-4627-9282-1fe3a8969aaa None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:23.717156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:23.717806 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:23.718070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:23.718357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:23.722098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:23.723549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:23.725159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 214/426] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:23 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:23.733120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:23.829576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a91611-abc2-4d34-b7e0-1c01a1de3a92 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:23.838981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.899731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17760365-6f9c-4af7-a338-2795d2c20788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:23.901084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17760365-6f9c-4af7-a338-2795d2c20788 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:23.901638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17760365-6f9c-4af7-a338-2795d2c20788 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:23.902138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17760365-6f9c-4af7-a338-2795d2c20788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:23.925574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:23.933154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dac88-8de2-4a10-902d-1ca66ccae6cd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:24.006672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:24.007329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.009476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.009781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.010524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=a419c813a6bf4516b4bfadac726c8046) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:24.010895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:24.014866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:24.031126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 215/427] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:23 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 611 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:24.050674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17760365-6f9c-4af7-a338-2795d2c20788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:24.052416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17760365-6f9c-4af7-a338-2795d2c20788 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:24.179289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 213/428] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:24.186920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:24.363684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1eea-8ff1-4ad8-bde1-ab285e90e56e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:24.386104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:24.389478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cd37-ce1d-4307-a4a7-6b74f1284a3b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.389921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cd37-ce1d-4307-a4a7-6b74f1284a3b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.390087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cd37-ce1d-4307-a4a7-6b74f1284a3b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.391737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 214/429] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:24.396935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.407895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.407895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.430681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:24.431810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:24.432748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.433266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.433734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] PATH_INFO: `/v3/projects/a419c813a6bf4516b4bfadac726c8046` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.436170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:24.437278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] RBAC: Authorizing `identity:get_project(project_id=a419c813a6bf4516b4bfadac726c8046)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:24.438963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:24.443513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 216/430] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:24 2022] GET /identity/v3/projects/a419c813a6bf4516b4bfadac726c8046 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:24.452468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:24.494077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:24.545714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 215/431] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:24.631135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbe47-2750-4484-b818-2df0ba477e4e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:24.678416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e78a4-f9a8-4583-a6f0-f61541ab95d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:24.679032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e78a4-f9a8-4583-a6f0-f61541ab95d0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.679340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e78a4-f9a8-4583-a6f0-f61541ab95d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.679732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e78a4-f9a8-4583-a6f0-f61541ab95d0 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.680955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e78a4-f9a8-4583-a6f0-f61541ab95d0 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:24.682355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e78a4-f9a8-4583-a6f0-f61541ab95d0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:24.684232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 217/432] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:24 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:24.695935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:24.774536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27edb82-5dfc-4e4c-9de6-7ad6c8ed6a7e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.775201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27edb82-5dfc-4e4c-9de6-7ad6c8ed6a7e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.775685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27edb82-5dfc-4e4c-9de6-7ad6c8ed6a7e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.777671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 218/433] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:24.791773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.792633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.793127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.821537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:24.823363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:24.839956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6d6ca-f2ac-4e98-9866-18e7185db6ee None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:24.889277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:24.904559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:24.905181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:24.905489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:24.906032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:24.906482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=b06842f53bac40fc821b025679907505, scope.project.id=a419c813a6bf4516b4bfadac726c8046) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:24.906786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:24.908236 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:24.917104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 216/434] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:24 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=a419c813a6bf4516b4bfadac726c8046&role.id=b06842f53bac40fc821b025679907505 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:24.918255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:24.919362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 219/435] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:24.961138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.053620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b5ae-c8e3-43d5-8d10-4d5939a06b67 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.099363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.100472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.100988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.102082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.126279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:25.139499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:25.140423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:25.141320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:25.141929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 217/436] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:25.149193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.225671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.269553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df7e6-7ade-4c0d-88d4-4a720f0c4095 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.313745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.314349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.316810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.317355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.318046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:25.318347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:25.319718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c912-6f18-4543-bd63-81e6d347ac51 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:25.329313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 220/437] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:25.330581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e38f-826d-433d-a357-26add92338e1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.330861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e38f-826d-433d-a357-26add92338e1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.331193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e38f-826d-433d-a357-26add92338e1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.334522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 221/438] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:25.338908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.339189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.339456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.349938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.357977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ec02b-51a9-451a-95ce-9d6198ce675a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.364459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:25.364459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:25.396815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.401970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318456-bf48-4937-8672-140f239a260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.402658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318456-bf48-4937-8672-140f239a260f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.402924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318456-bf48-4937-8672-140f239a260f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.404149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318456-bf48-4937-8672-140f239a260f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.416371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3318456-bf48-4937-8672-140f239a260f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d3318456-bf48-4937-8672-140f239a260f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:25.421386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:25.422367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:25.423203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 218/439] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:25.423869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318456-bf48-4937-8672-140f239a260f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.438309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 222/440] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:25.442100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.550848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318456-bf48-4937-8672-140f239a260f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.552563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1990b4-6b9f-4ed3-95fe-46aff2f2673c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.600436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.601998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.602596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.602865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.603125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.603790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:25.604083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:25.605478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:25.606910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.607237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.607502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.629474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 223/441] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:25.631722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.650742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.668986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.717536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:25.719010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:25.758828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda9c14-7453-4002-a91f-51c4a2434698 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.796137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.796737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.797446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.797718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.823786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 219/442] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:25.824697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.882041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.884468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:25.885992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:25.916240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:25.925862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506bef-2f8a-4f95-b895-7eee40f75852 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:25.959640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:25.960252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:25.961255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:25.961613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:25.971667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:25.976965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:25.978036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:25.978904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 220/443] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:25.980464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:25.986821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 224/444] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:25:25.987850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.077253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea80574-2551-41a6-9fd2-feaa8f1b5e5a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.084828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431cc93-b09b-465e-9452-194d57b9f8b4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.093174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.110713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.111326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.111599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.111865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.121347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.121460 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.121537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.121537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 221/445] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.121537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.121935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.121935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.121935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.121935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.122182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:26.122182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.122182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.130207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 225/446] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.130873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.217439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c7f4-e5ad-44de-80d8-1a70227fc350 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.229897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a7887-d5b2-4ff7-b1af-124f93cd0f26 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.248897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.249536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.249810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.250077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] PATH_INFO: `/v3/projects/9b0ff383259a46ada3cebd0e725c6559` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.251149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] RBAC: Authorizing `identity:get_project(project_id=9b0ff383259a46ada3cebd0e725c6559)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.252601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.254225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 222/447] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/projects/9b0ff383259a46ada3cebd0e725c6559 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.254964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.267231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.267859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.268144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.268415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.269562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.270993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.272540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 226/448] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.273935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.307340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.338345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.353739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae5c7-4a6a-4687-b421-a5e3a451d823 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.376228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7e840-e9c3-47a7-a894-26a71a78f455 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.386967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.387559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.387837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.388101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.409715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.410326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.410598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.410862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] PATH_INFO: `/v3/groups/ef2f2687b64d42f5bc52a48493ca046c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.411943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] RBAC: Authorizing `identity:get_group(group_id=ef2f2687b64d42f5bc52a48493ca046c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.413463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.415189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 227/449] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/groups/ef2f2687b64d42f5bc52a48493ca046c => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.415930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.458786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.460230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.510931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.513852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1dc8-0e19-4f2d-9aa7-d9cbc1d1b92e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.542447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.547945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.548536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.548813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.549079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.549819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=b06842f53bac40fc821b025679907505, scope.project.id=9b0ff383259a46ada3cebd0e725c6559) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:26.550120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.551581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.557997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 228/450] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=b06842f53bac40fc821b025679907505 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.558776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.559186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 223/451] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:26.564868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.674640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b533f4-ca8f-4cfc-a9e7-5f1802ac563a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.681580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31037-c82d-4264-96ba-62958fa941b3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.713560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.714337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.714947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.715225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.716130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] RBAC: Adding query filter params (group.id=ef2f2687b64d42f5bc52a48493ca046c, role.id=1b11b6b4c5ef4fb99f930f82af2a2421, scope.project.id=9b0ff383259a46ada3cebd0e725c6559) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:26.716417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.717920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.719609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.720250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.720530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.720799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] PATH_INFO: `/v3/projects/ff309e01cdfe4cb7b8cf92847353f141` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.722057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ff309e01cdfe4cb7b8cf92847353f141)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.723521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.729425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 229/452] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/role_assignments?group.id=ef2f2687b64d42f5bc52a48493ca046c&scope.project.id=9b0ff383259a46ada3cebd0e725c6559&role.id=1b11b6b4c5ef4fb99f930f82af2a2421 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.729630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 224/453] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/projects/ff309e01cdfe4cb7b8cf92847353f141 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:26.735626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.804765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:26.849351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ccc7-eec2-4f67-9599-3c739c9adf66 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:26.886159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed24f8-6ff7-4a48-b704-57b9249ff64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:26.886706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed24f8-6ff7-4a48-b704-57b9249ff64c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:26.886978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed24f8-6ff7-4a48-b704-57b9249ff64c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:26.887247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed24f8-6ff7-4a48-b704-57b9249ff64c None admin] PATH_INFO: `/v3/groups/b08f6465515248d89c29be1424c5ac1e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:26.888387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed24f8-6ff7-4a48-b704-57b9249ff64c None admin] RBAC: Authorizing `identity:get_group(group_id=b08f6465515248d89c29be1424c5ac1e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:26.889850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed24f8-6ff7-4a48-b704-57b9249ff64c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:26.891427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 230/454] 10.222.0.64 () {56 vars in 1180 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/groups/b08f6465515248d89c29be1424c5ac1e => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:26.897476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:26.922565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:27.001891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e35ac-8f68-4d3b-882f-12df435363b6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:27.037072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:27.037761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:27.038034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:27.040121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:27.040121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] RBAC: Adding query filter params (group.id=b08f6465515248d89c29be1424c5ac1e, role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=ff309e01cdfe4cb7b8cf92847353f141) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:27.040306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:27.041710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179955c-21f6-4e22-9ceb-ff4a1e706577 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:27.047539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 225/455] 10.222.0.64 () {56 vars in 1376 bytes} [Fri Sep 9 11:25:26 2022] GET /identity/v3/role_assignments?group.id=b08f6465515248d89c29be1424c5ac1e&scope.project.id=ff309e01cdfe4cb7b8cf92847353f141&role.id=137cd8e0839747668eef67677a0171b5 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:29.682909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1857e-7d9b-48c3-b7a6-b31200222efe None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:29.683446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1857e-7d9b-48c3-b7a6-b31200222efe None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:29.683446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1857e-7d9b-48c3-b7a6-b31200222efe None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:29.685030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 231/456] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:29.690439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd5a5-b01f-4fd6-8183-b10eacc17dc8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:29.690848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd5a5-b01f-4fd6-8183-b10eacc17dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:29.691014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd5a5-b01f-4fd6-8183-b10eacc17dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:29.713450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e2ccd5a5-b01f-4fd6-8183-b10eacc17dc8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:29.714628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e2ccd5a5-b01f-4fd6-8183-b10eacc17dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:29.815913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 226/457] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:30.089447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1857e-7d9b-48c3-b7a6-b31200222efe None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:30.171190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3822-9c49-443a-9ea8-152d363f8045 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.171537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3822-9c49-443a-9ea8-152d363f8045 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.171740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3822-9c49-443a-9ea8-152d363f8045 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.176991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 227/458] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:30.195025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ad62-8e0c-4f7d-bb92-f6f1dcd088f7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.195312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ad62-8e0c-4f7d-bb92-f6f1dcd088f7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.195565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ad62-8e0c-4f7d-bb92-f6f1dcd088f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.224176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1857e-7d9b-48c3-b7a6-b31200222efe None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:30.243056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-25d9ad62-8e0c-4f7d-bb92-f6f1dcd088f7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:30.244570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-25d9ad62-8e0c-4f7d-bb92-f6f1dcd088f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:30.258272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:30.268127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:30.283796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:30.284979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.285506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.285968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.302628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:30.305149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:30.328326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 228/459] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:30.328326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ae632-8c50-4a5e-a57e-b61b722a0691 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.328326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ae632-8c50-4a5e-a57e-b61b722a0691 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.328326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ae632-8c50-4a5e-a57e-b61b722a0691 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:30.328982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:30.330023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:30.330881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:30.330881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:30.330881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:30.337235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 229/460] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:30.337235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803e7e-25e5-4d7c-a2d5-fd6fe8cbc488 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.337235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803e7e-25e5-4d7c-a2d5-fd6fe8cbc488 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.337235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803e7e-25e5-4d7c-a2d5-fd6fe8cbc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.338437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 232/461] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:30.348761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:30.361262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-de803e7e-25e5-4d7c-a2d5-fd6fe8cbc488 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:30.361262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-de803e7e-25e5-4d7c-a2d5-fd6fe8cbc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:30.468206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 230/462] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:30.470525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980ad7b-564a-4393-8ea3-aeff0d68d7e8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.471015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980ad7b-564a-4393-8ea3-aeff0d68d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.471453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980ad7b-564a-4393-8ea3-aeff0d68d7e8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.473106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 231/463] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:30.484434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.486744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.487195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.515767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188caff-5e29-41e5-b77a-4b5d1626baf6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:30.520128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:30.525227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:30.574309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:30.576312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.580722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.581000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.581689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:30.581992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:30.583353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:30.610358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 233/464] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:30.613529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:30.635007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 232/465] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:30.661537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:30.669929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:30.687929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:30.749937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a5515-9b88-4bad-9920-a045eac1a3be None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:30.794274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:30.794874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.795144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.795403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.796034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:30.797461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:30.821670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778fea-ee16-413f-852f-162ae18d979d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:30.858688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:30.859316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:30.859595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:30.859866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:30.870316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:30.871708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:30.888166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:30.889108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:30.890301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:30.890301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:30.890301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:30.890301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 233/466] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:30.890518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:30.939820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 234/467] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:30 2022] POST /identity/v3/users => generated 246 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:30.941014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:30.958415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:31.014379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2ed7-b28c-4197-a999-0558a8da07d5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.052604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.054591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.055119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.055486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.068123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.070397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.076085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:31.083470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bebc1e-4c19-4c98-9c0b-12a856dfca7b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:31.086964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:31.093801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:31.094719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:31.094719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:31.094719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:31.094719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 234/468] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:31.094719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:31.141655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.142674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.143528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.144046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.145681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:31.148399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.150120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.165956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 235/469] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:31.167166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:31.223708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03228-e63f-462b-83ba-9030c4e8234f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.235987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:31.271387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.272087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.272358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.272640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.283647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.285096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.296656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941631e-9200-44da-bbfb-db4769e0229a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:31.299699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:31.300595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:31.301477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:31.301477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:31.301477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:31.301477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 235/470] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:31.301708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:31.336946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.337779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.338113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.339246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.339871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:31.340172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.341560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c92be-ea62-45f7-8ca1-3956f0bfebb2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.359253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 236/471] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:31.359253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3acdc0-b13c-4e4c-9600-a0196810c82a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.359253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3acdc0-b13c-4e4c-9600-a0196810c82a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.359253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3acdc0-b13c-4e4c-9600-a0196810c82a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.359253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 237/472] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:31.359253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3acdc0-b13c-4e4c-9600-a0196810c82a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:31.375674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:31.413534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff72a6-e271-4ca5-ad48-eb091374900c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.449351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad7c1e-c508-4a15-9125-cabc74ef3964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.450262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad7c1e-c508-4a15-9125-cabc74ef3964 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.450705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad7c1e-c508-4a15-9125-cabc74ef3964 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.450978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad7c1e-c508-4a15-9125-cabc74ef3964 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.451621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad7c1e-c508-4a15-9125-cabc74ef3964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.453066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad7c1e-c508-4a15-9125-cabc74ef3964 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.472911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3acdc0-b13c-4e4c-9600-a0196810c82a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.506632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.507351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.507853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.508128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.508755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:31.509052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.510506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.523420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 238/473] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:31.524192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:31.546294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 236/474] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:31 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:31.548111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.548562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.548840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.588710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:31.590742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:31.607058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:31.645104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:31.681518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58069-6ae5-43fe-8723-d0f21b63b87d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.692252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 237/475] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:31.698577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:31.733679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.734996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.735483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.735975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.736848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.739186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.812583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7055a-0c10-410e-8fe4-71388ad63df9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:31.850434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 239/476] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:31 2022] POST /identity/v3/users => generated 248 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:31.856348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:31.857690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:31.858131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:31.858594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:31.859572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:31.861494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:31.987386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 238/477] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:31 2022] POST /identity/v3/users => generated 249 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:32.029264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:32.171707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22852-18f8-4054-ae2a-d090bae8c7c5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:32.203457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:32.209822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:32.210554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:32.210831 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:32.211097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:32.211809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:32.213314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:32.277643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.sql.core [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 11:25:32.277643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 11:25:32.277643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [parameters: {'id': 'e44301cc52d643159035f658d2ebec4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 11:25:32.277643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application result.read() Sep 09 11:25:32.296125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:25:32.297067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application yield resource Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise self.value Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application session.commit() Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:25:32.298504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:25:32.299381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:25:32.300320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application result.read() Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:25:32.301260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [parameters: {'id': 'e44301cc52d643159035f658d2ebec4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:32.302102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 11:25:32.303847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:32.307228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 240/478] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Sep 9 11:25:32 2022] POST /identity/v3/roles => generated 144 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:32.315555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:32.318661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:32.463465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b025-a86f-4e20-8644-89fd51492472 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:32.514864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7894-96d8-4a77-8414-566134ac3e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:32.515879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7894-96d8-4a77-8414-566134ac3e69 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:32.516356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7894-96d8-4a77-8414-566134ac3e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:32.516825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7894-96d8-4a77-8414-566134ac3e69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:32.531284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7894-96d8-4a77-8414-566134ac3e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-feee7894-96d8-4a77-8414-566134ac3e69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:32.537007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:32.538002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:25:32.538817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:32.541083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 239/479] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:25:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:32.550296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:32.705245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b5e3a-6c14-4ce8-9eae-a7e7ff0549c5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:32.761008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:32.761694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:32.761902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:32.762170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:32.762837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:32.763135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:32.764502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d710d-825b-4e24-80e3-928140c4c741 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:32.773984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 241/480] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:33.422631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196b9d-b224-4260-bfa1-439259844a0d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:33.423344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196b9d-b224-4260-bfa1-439259844a0d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:33.423344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196b9d-b224-4260-bfa1-439259844a0d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:33.424742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 240/481] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:33.430568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:33.430854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:33.431130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:33.458192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:33.459437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:33.522041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:33.547707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 242/482] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:33.918497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196b9d-b224-4260-bfa1-439259844a0d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:34.036331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:34.098555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196b9d-b224-4260-bfa1-439259844a0d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:34.147913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086b0ff-6fae-474d-8d58-574239457a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:34.148543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b0ff-6fae-474d-8d58-574239457a2b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.148816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b0ff-6fae-474d-8d58-574239457a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.149079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b0ff-6fae-474d-8d58-574239457a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.166904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086b0ff-6fae-474d-8d58-574239457a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3086b0ff-6fae-474d-8d58-574239457a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:34.172134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:34.173013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:34.174436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 241/483] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:34.179125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:34.199538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393818aa-e447-4d2d-99ff-db398ed55366 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.199834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393818aa-e447-4d2d-99ff-db398ed55366 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.200068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393818aa-e447-4d2d-99ff-db398ed55366 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.201578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 242/484] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:25:34.207110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.207387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.207653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.235655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:34.236831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:34.363052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 243/485] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:34.365347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aed23-fe8a-429d-958b-422cdaecdfa0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:34.426007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:34.426545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.426822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.427090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.428025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:34.428423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:34.429818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658525-2514-4f48-8e4e-9000300a9a5e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:34.438046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 243/486] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:34.444348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:34.533196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:34.599375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83ede-7e40-43b1-9aec-c20adc86b144 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:34.663420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:34.664132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.664411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.664677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.669756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28f904-5e18-4c8a-89db-e8ef35b4a9ad None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.670045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28f904-5e18-4c8a-89db-e8ef35b4a9ad None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.670319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28f904-5e18-4c8a-89db-e8ef35b4a9ad None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.671775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 244/487] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:34.679039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:34.680883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28f904-5e18-4c8a-89db-e8ef35b4a9ad None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:34.682646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d1813723-c9d1-47db-ae91-ae41408b8d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:34.700038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:34.701017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:34.702285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:34.702285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:34.702285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:34.704280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 244/488] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:34.705805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.706293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.706764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.726159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:34.727642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:34.738351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:34.799495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28f904-5e18-4c8a-89db-e8ef35b4a9ad None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:34.807260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 245/489] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:34.808598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:34.837662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:34.838299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.838620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.838940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.846621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:34.851314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:34.856645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:34.866613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 245/490] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:34.867441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:34.944917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c428cc-ac2f-41ce-ad5b-a981a6adc225 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:34.969911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c333cd-417d-4230-94e3-b742a30bd264 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:34.979963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:34.985399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:34.986856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:34.987429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:34.987838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:34.988745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:34.989505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:34.993141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44887ca-c2e2-4267-8d6f-11dac8c0d1f7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.009795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.010642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.011059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.011497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.012297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:35.017556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 246/491] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:35.017556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3660-c941-4f32-9aee-c1c91722f5a5 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.017556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3660-c941-4f32-9aee-c1c91722f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.017556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3660-c941-4f32-9aee-c1c91722f5a5 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.017556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 247/492] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:35.017975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3660-c941-4f32-9aee-c1c91722f5a5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.018566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.020184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e662-a088-4702-ada2-9171021f69d1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.033351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 246/493] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:35.034738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.035187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.035600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.054920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:35.056133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:35.133239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 247/494] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:35.133239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.152821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.166550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3660-c941-4f32-9aee-c1c91722f5a5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.212690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.213688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.214451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.214902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.225540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.227824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:35.246608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:35.247538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:35.248444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:35.250576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.252481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 248/495] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:35.253529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.253835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e234f33-34b4-45ac-94c7-900f75de4007 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.291107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.292002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.292122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.292359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.307041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.308687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:35.328498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:35.329611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:35.330471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:35.330471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:35.330471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:35.336082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 248/496] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:35.336082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.379376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1263d-8abf-4e52-b612-c3c8a634b4af None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.415178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.415911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.416090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.416318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.427197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:35.432477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:35.433390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:35.434324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:35.437531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 249/497] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:35.438880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.460280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.461345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa140e-af55-481a-9a36-09e0606eae96 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.496152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.496668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.496940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.497338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.497960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:35.498256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.499697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.538396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 249/498] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:35.538396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.554137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.559930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a7e8-912c-4400-b74e-23b666b5c348 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.597941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.598534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.598813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.599118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.599752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:35.600169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.601579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.616777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 250/499] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:35.618847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.653719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064283f-87be-4d0e-b069-f09a8563f91b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.695328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66886287-a392-49b7-a509-055ad229a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.695979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66886287-a392-49b7-a509-055ad229a84c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.696253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66886287-a392-49b7-a509-055ad229a84c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.696520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66886287-a392-49b7-a509-055ad229a84c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.708267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66886287-a392-49b7-a509-055ad229a84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:35.711354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-66886287-a392-49b7-a509-055ad229a84c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:35.713354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:35.714292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:35.715098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 250/500] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:35.715782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66886287-a392-49b7-a509-055ad229a84c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.749067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7577c-be40-4eea-93cd-c8af8a0b9837 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.786285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.787178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.787456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.787726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.788380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:35.788679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.790400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.793387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.798869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 251/501] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:35.799508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:35.830609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66886287-a392-49b7-a509-055ad229a84c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.866947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.867545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.867819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.868090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.898492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428c49-d6a8-4017-9688-4eb58f265f24 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:35.935731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.936096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:35.936753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:35.937023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:35.937247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.937364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:35.940656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:35.946200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:35.947618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:35.959131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:35.961992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 252/502] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:35.962950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.008718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.040794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 251/503] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:36.041656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.064530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b047fb8-a6b6-4726-929e-906af5352911 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.097554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.098152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.098427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.098695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.100006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:36.100383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.101700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738f8-bf0c-4f51-a4ce-5a3b9eea3771 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.109353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 253/504] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:36.110500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aeb04-d413-4b37-8a43-8ae411a5d68b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.110786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aeb04-d413-4b37-8a43-8ae411a5d68b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.111054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aeb04-d413-4b37-8a43-8ae411a5d68b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.113107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 254/505] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:36.113107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aeb04-d413-4b37-8a43-8ae411a5d68b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.145160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6745-403d-4ebe-b6e1-b54e74bf17ce None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.171701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.179425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.183674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.183674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.183674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.190836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.192303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:36.207963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:36.209458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:36.210312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:36.210312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:36.210312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:36.210312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 252/506] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:36.210696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.216461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aeb04-d413-4b37-8a43-8ae411a5d68b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.235177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.249929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.250515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.250789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.251057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.251760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:36.252057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.253588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.291178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 255/507] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:36.291917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.311070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0fdb1-8451-4c90-a833-16adc4089275 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.344697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.345355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.345635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.345907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.357127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.358599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a740e52b-0ae6-4c53-889e-b457059cc02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:36.373279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:36.374859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 253/508] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.376509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.393723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d7de3-9b86-4273-a18f-a81e345ac073 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.394096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:36.395306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:36.410692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.428593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.429228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.429556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.429833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.439688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.441202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:36.456823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:36.457744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:36.459163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:36.459163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:36.459163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:36.459163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 256/509] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:36.459383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.466646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 254/510] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:36.467485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.479623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.563178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08df17-1603-4afb-acea-6404308e2cbe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.578795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb824519-6ad4-40cb-9845-816257f3a884 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.597085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.597705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.597991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.598261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.599464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:36.599760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.601125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.613961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 257/511] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:36.613961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.625112 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.625878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.626558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.626558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.648260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.702384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.704659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.707834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.722971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94672-de9a-4814-9a76-0b1590645d15 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.758254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.758847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.759122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.759391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.760014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:36.760310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.761721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.773424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 258/512] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:36.774434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.813089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 255/513] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:36.814091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.859830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.871612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c27a-c641-4084-8199-ae84f98f9c9e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.906201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.906789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.907069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.907336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.907954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:36.908250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.909688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.913418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf6ff-e7b6-4d03-a17e-3df78e7bdd1c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:36.915738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:36.921477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 259/514] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:36.922316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:36.953324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:36.953944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:36.954218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:36.954484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:36.962285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:36.963722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:36.978155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:36.979096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:36.980038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 256/515] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:36.980598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.027499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fae93-92b5-4c82-9e64-08dd1a5869f2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.061349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.061964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.062242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.062519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.073859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.075262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.081267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d27fa-c22b-4fec-909c-88e4e22836da None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.083356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:37.090025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:37.090903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:37.091760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:37.091760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:37.091760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:37.091760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 260/516] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:37.091972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.120319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.120944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.121238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.121516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.127986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.129444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:37.142364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:37.143433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 257/517] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:37.144296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.170148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.193179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826eccf-5b00-430d-9a62-8227088bfeaa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.227536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.228158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.228436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.228704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.238953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.240405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.243401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009843a2-aca4-43b7-adf2-84da7d1a6063 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:37.254068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:37.255624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:37.257097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:37.257097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:37.257097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:37.257097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 261/518] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:37.257097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.282243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.282864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.283139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.283407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.291340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.292770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:37.308974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:37.310110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 258/519] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:37.316446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.317092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.362297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e89d46-51b5-4920-a9eb-3557e20ed964 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.395707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.396791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.397063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.397654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.398065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:37.398365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.399785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.399907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.415526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc4c1-0431-4d57-b80a-a2985533a392 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.416441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 262/520] 10.222.0.64 () {56 vars in 1139 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:37.417240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.451268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.451864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.452139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.452411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.453038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:37.453367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.454720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.467033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 259/521] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:37.467825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.518453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c69acf-1b57-41d0-9b2a-f2816f6e3cc4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.529690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.552843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.553485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.553790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.554022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.554708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:37.555004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.556431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.567449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc232a8e-6e97-4b2e-8583-1c876ba2405a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.574296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 263/522] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:37.575093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.607321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.607920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.608194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.608462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.609091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:37.609420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.610785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.622538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 260/523] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:37.623400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.626957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.680774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f2a7-94f4-4e8a-8477-795abca96491 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.716012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.716613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.716889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.717152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.717904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:37.718205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.719642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.723635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389b15-bc72-4c26-a694-97b3e89d2d68 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.741224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 264/524] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:37.741618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.760850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.761478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.761755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.762025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.772316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.828260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.829809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.832334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:37.842668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cb859-1cc8-43ab-978b-20d3c7ce7082 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:37.876037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:37.876564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:37.876841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:37.877114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:37.877770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:37.879198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:37.927001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 261/525] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:37.927915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:37.979961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 265/526] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:37 2022] POST /identity/v3/users => generated 247 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:25:37.980783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.037594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653b5f1-27ea-4c6d-865a-be8546d2746f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.041175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.078993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.079358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.080322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.080505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.080880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.081528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f354bf4e63d949ecbb86b123a7022293) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:38.081833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.084025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.101259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 262/527] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/role_assignments?user.id=f354bf4e63d949ecbb86b123a7022293&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:38.101259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.106594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a1506-6acc-4c75-ba2e-498c9e84430d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.160683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.161823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.162093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.162362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.170991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.172477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:38.187479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:38.188426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 266/528] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:38.189803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.251319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e8e19-8a78-4d08-a64f-6527c86a18bd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.297035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.297764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.298045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.298316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.319059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319175-00e8-49c1-b61e-8a91bfda8999 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.340500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.360571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.361837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.362182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.362516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.377558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.377863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.379243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.380935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.382973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:38.399980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:38.401020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:38.401996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:38.401996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:38.401996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:38.405258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 267/529] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:38.405258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.512722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 263/530] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:38.513603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.525570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aab78-06f6-43d3-93ba-2e5f0e4fa1d0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.562316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.562912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.563185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.563453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.564237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:38.564540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.566171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.580749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 268/531] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:38.585850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.594747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.647599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ad85-9115-4af6-9bda-bec636554ba7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.656335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.695099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.696139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.696502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.696863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.697887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:38.698282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.700432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.704755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6566334-17e0-4dba-89ae-e849391f210d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.718949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 264/532] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:38.718949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.749566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.750561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.751165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.751644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.764518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.765970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:38.785728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:38.787283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:38.788212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:38.788212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:38.788212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:38.789286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 269/533] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:38.790488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.843005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530a25-01bf-4f35-a442-495f3676f242 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.875836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:38.889298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:38.890379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:38.890660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:38.890930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:38.891931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=d02a5e02723a4c29ad8872f269138453) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:38.892242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:38.893775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:38.907977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 265/534] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/role_assignments?user.id=d02a5e02723a4c29ad8872f269138453&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:38.907977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:38.936431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb8473-2b6d-4aa8-b9e4-aa443f0650a4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:38.955715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:39.011758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.012842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.013342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.013808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.021699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b312f0-aa13-43d6-81ca-9863f8d8654e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:39.030770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.032999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:39.055643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:39.056642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:39.057531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:39.060023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 270/535] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:39.064593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.064593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.064593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.064593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.064925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:39.064925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.064925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.066620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:39.077764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 266/536] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:39.084799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:39.151414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:39.205675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3453121-835d-4690-a729-5c9b590e27fc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:39.251735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.252365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.252641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.252916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.264995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.268409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.285087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6be23-aa35-465e-bc1c-79e6b81d4358 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:39.289946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:39.290775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:39.291608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:39.292430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 267/537] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:39.298159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:39.326480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.327455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.327989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.328453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.329351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:39.329982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.333125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.347997 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 271/538] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:39.363013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:39.404500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:39.522627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce54b-4132-44a9-9141-e39b89e876d6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:39.525051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42629-70c1-4672-94aa-68c1a844778c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:39.553687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:39.592587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.594050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.594895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.596073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.596537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.597044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.597929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.599118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:39.599607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.600040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.600949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f342c15c234b4d6592404de7e7bee866) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:39.602618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3a78-0f17-4bf4-a568-28671961f0e6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.603154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.604776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.621892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 272/539] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:39 2022] GET /identity/v3/role_assignments?user.id=f342c15c234b4d6592404de7e7bee866&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:39.642882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 268/540] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:39.649729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:39.777389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:39.787148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109721ae-7083-419f-9a86-5aefdf91e9cd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:39.835041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:39.835616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:39.835897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:39.836156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:39.836875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=3f69a6b87a274ca3b4d658080992abb0) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:39.837192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:39.838983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923490e-8abf-4e42-b0a8-3c78284a745d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:39.850274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 273/541] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:39 2022] GET /identity/v3/role_assignments?user.id=3f69a6b87a274ca3b4d658080992abb0&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:40.447113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999812e8-eddc-488f-a4d6-2cf3d4717708 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:40.447494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999812e8-eddc-488f-a4d6-2cf3d4717708 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:40.447697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999812e8-eddc-488f-a4d6-2cf3d4717708 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:40.449289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 269/542] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:40.454622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:40.454912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:40.455185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:40.474178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:40.475374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:40.493181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec47bb-7321-4c3b-a32a-373e0d0412ee None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:40.493505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec47bb-7321-4c3b-a32a-373e0d0412ee None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:40.493750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec47bb-7321-4c3b-a32a-373e0d0412ee None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:40.495316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 270/543] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:40.500268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:40.500556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:40.500827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:40.533844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:40.536980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:40.580363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 274/544] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:40.635944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 271/545] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:40.877283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:40.990368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:41.020451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b44985-e72b-472e-82cd-4d701c993982 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.070115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.070781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.071055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.071319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.087679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:41.092551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:41.093532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:41.094403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 275/546] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:41.100368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.107100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.285078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521e151-7fc2-4063-ae89-e82a3598800d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.286900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb31f-6795-405e-966f-f56a2b2903f3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.288626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:41.322288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.323019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.323368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.323712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.327637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.328452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.329006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.329509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.330562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:41.331053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:41.334218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:41.335242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:41.340683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:41.341831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:41.343347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:41.344926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 276/547] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:41.347675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 272/548] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:41.353337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.354146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.363439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:41.470794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadc378-e1df-441a-aa05-62310681dd63 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.510275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.511300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.511863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.512443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.513489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:41.514036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:41.515752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad65bc-7eec-4e8d-8ab9-26c2129d7c98 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:41.527454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 277/549] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:41.532628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b057-a082-43bc-8751-631b5af5d455 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.532628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b057-a082-43bc-8751-631b5af5d455 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.532628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b057-a082-43bc-8751-631b5af5d455 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.532628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 278/550] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:41.535222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b057-a082-43bc-8751-631b5af5d455 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.560637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932cd4-6128-4f59-8180-7cd5ca6ed51e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.598680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.599375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.599565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.599839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.611962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:41.613968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:41.627947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5542cea5-b6ac-478a-bf7f-992361c60b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:41.638825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:41.646961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 273/551] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.648033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.665087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:41.666682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:41.680696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:41.683231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b057-a082-43bc-8751-631b5af5d455 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.728093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.728868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.729248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.729623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.744122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:41.745773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 274/552] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:41.745908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:41.747047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:41.781588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:41.783817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:41.786923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:41.786923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:41.786923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:41.791086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 279/553] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:41.797506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:41.943156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee7d93-82a6-4b9d-b135-aabf843a81b0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.990012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:41.995775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eacc2-5d24-42dc-ac9b-0eb1edf22049 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:41.996304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:41.996304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:41.996304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:41.996304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:41.996304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:41.996304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.008989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 275/554] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:42.017251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.039878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.049864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.050496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.050773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.051619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.052401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:42.061340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.063840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.064066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.091793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 280/555] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:42.097595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.176723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfaa9c-1ab8-4304-854c-ec8bab34f3d8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.201671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3e98e-eaa2-42b3-8b26-332f93fec532 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.214572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.215545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.216138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.216631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.225427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.227363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.239402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.240326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.240604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.240873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:42.242506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:42.243544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:25:42.244486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:42.246952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 276/556] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:42.248033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.254777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.256542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:42.270414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:42.272116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 281/557] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:42.273070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.315418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.327735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.367536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef09f4a-c6af-4f67-873b-937f3e0d5d8a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.376651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb507b-4b37-4eb6-9f44-ed860c736aa5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.408492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.409290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.409666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.410150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.412772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.413410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.413692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.413956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.414667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:42.414963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.416384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c67936-7528-4926-a2eb-9b002a521d61 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.422212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:42.428000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:42.429313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:42.430395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:42.431366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 277/558] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:42.432148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.444188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 282/559] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:42.444188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21a1a-19a2-4858-a3b7-8c1de4931fcd None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.444188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21a1a-19a2-4858-a3b7-8c1de4931fcd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.444188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21a1a-19a2-4858-a3b7-8c1de4931fcd None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.444188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 283/560] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:42.444188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21a1a-19a2-4858-a3b7-8c1de4931fcd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.548731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb15b8-6312-4e10-b6f5-dc5e597ee217 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.552367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.556809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21a1a-19a2-4858-a3b7-8c1de4931fcd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.575621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.585052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.585686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.585963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.586233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.586959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:42.587257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.588684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.595873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.596469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.596740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.597002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.598226 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:42.598521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.599964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba850503-aa59-4c72-9a39-f1f7c5fd0e02 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.607105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 278/561] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:42.607979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 284/562] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:42.608086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.608940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5750-f09d-42ab-8365-116b16141cca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.609337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5750-f09d-42ab-8365-116b16141cca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.609561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5750-f09d-42ab-8365-116b16141cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.628771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d2ae5750-f09d-42ab-8365-116b16141cca None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:42.630501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d2ae5750-f09d-42ab-8365-116b16141cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:42.701903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 285/563] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:42.703227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4a63-ac5f-49a1-a29b-ead6b844d578 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.703538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4a63-ac5f-49a1-a29b-ead6b844d578 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.703768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4a63-ac5f-49a1-a29b-ead6b844d578 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.705044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 286/564] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:42.705760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d4a63-ac5f-49a1-a29b-ead6b844d578 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.726317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322aa5f-7300-4df4-8a1b-2eff64682e50 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.766071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf969-307c-4eac-96f4-5eaef76266a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.766668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf969-307c-4eac-96f4-5eaef76266a0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.766990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf969-307c-4eac-96f4-5eaef76266a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.767258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf969-307c-4eac-96f4-5eaef76266a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.802938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.813386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d4a63-ac5f-49a1-a29b-ead6b844d578 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:42.827695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:42.845180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf969-307c-4eac-96f4-5eaef76266a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.847152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf969-307c-4eac-96f4-5eaef76266a0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.850430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:42.850430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.850430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.850430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.860535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:42.862073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:42.877987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:42.879258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:42.880476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:42.880476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:42.880476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:42.885988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 287/565] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:42.885988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:42.960788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 279/566] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:42.962131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:42.962416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:42.962694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:42.982381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:42.983589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:43.045342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cbda1-8b9c-4dc0-8ce8-02f0c1369a5b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.050302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 280/567] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:43.051190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.065965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.092015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.092564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.092843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.093113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.104258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.105744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.107476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:43.120697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:43.121723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:43.122595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:43.122595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:43.122595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:43.122595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 288/568] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:43.122595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.160453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e03020-9fd9-495a-93de-57ff6a384f52 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.196134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.196739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.197016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.197321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.197967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:43.198265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.199621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.212079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 281/569] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:43.212899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.226941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc220-9a2b-4ad5-9d88-cd522b2f537f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.262876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.263864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.264150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.264450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.275072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.276539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:43.291191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:43.292144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:43.293043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:43.293043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:43.293043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:43.295531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.296932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 289/570] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:43.298069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.320050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fde06a-5cb0-4ff2-a216-aaf62aed0568 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.357008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.357619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.357900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.358210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.365100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.370343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:43.375627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:43.381725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 282/571] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:43.382599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.419665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312c37d-8641-4752-8222-07433ec10c22 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.452741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.453363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.453643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.453914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.454543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:43.454838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.456207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.467929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 290/572] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:43.468712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.482863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e83041-46ca-4b10-af68-29cea9aad3c9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.517859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.518477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.518754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.519019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.521079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.526287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.527721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:43.538952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:43.539907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 283/573] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:43.540803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.570269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380fe2f-cf9b-4223-b083-490fb5bd70e2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.577651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.608642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.609165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.609472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.609739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.610362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:43.610693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.612059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.623646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 291/574] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:43.624754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.652433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1002a-4dbb-4e4d-b429-b9b46ae50247 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.685708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.686323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.686591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.686853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.696940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:43.702086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:43.703231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:43.704121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 284/575] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:43.704834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.733576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434697da-e9f9-4017-9abf-4a31e910bf36 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.758760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.766403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.766998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.770934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.770934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.770934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:43.770934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.770934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.778860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 292/576] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:43.779642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.804613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5e10-8c46-45f1-acad-b52bf163c759 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.808060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.839098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.839714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.839982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.840247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.847534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.848953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:43.859704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:43.860763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 285/577] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:43.862115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.888511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc21ee-df98-4324-96d1-5d42840a6e9a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.922113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.922702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.922976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.923242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:43.924247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:43.924543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:43.926644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:43.938731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 293/578] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:43.939539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:43.962230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7ec6-59a5-44c9-a779-374dd6a06491 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:43.976220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:43.996561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:43.997520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:43.997990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:43.998451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.009708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.011319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:44.025049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:44.026232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:44.027232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:44.029490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 286/579] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:44.030274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.038829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.051170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f98d1a-c1b0-4d4a-b639-2028946bed3f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.085135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.085757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.086034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.086305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.086955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:44.087252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.088626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.096229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 294/580] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:44.096998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.136821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536323-5fb4-4b6f-9960-d8b535ce0486 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.170027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.170640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.170917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.171184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.182001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.183440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.195200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610f414-f7ea-4bbd-86dc-bcb5a1b3b640 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:44.197022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:44.198149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:44.199166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:44.199166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:44.199166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:44.199166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 287/581] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:44.203344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.228940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.229553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.229836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.230101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.230805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:44.231109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.231298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.232518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.249187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 295/582] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:44.249996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.260772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.308754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c37d50-de0f-4e15-b7c9-8597db21f2a6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.343712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.344366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.344641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.344907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f354bf4e63d949ecbb86b123a7022293/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.353085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ad95-88a3-41c3-9e31-f590178ed3f3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.359554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=f354bf4e63d949ecbb86b123a7022293, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.360987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.388576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.389095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.389408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.389683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.390359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:44.390659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.392084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.403549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 296/583] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:44.404339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.457810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 288/584] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:25:44 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f354bf4e63d949ecbb86b123a7022293/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:44.458668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.483170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.523523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b0a78-0dc8-4f72-8e53-04c750e58e6d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.546789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.570975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.571626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.571903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.572177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.572755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a06013-aac4-4ba2-9166-6593990a98b0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.587235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.589235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:44.605635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:44.606984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:44.608479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:44.608479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:44.608479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:44.608479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 297/585] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:44.608479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.619189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.619834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.620114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.620381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.621029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:44.621399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.625042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.639079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 289/586] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:44.639884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.726860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848b98-1b80-471f-9a88-f5df58699456 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.747808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.758051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c253-b3a0-4345-a53d-bed0a7177421 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.762365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.766389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.766389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.766389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.774417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.775873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:44.791169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:44.792185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:44.793103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:44.793103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:44.793103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:44.793103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 298/587] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:44.793103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.800120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.801331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.801608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.801867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.802580 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=90ff1707eb264477b0a120e10c5d7a63) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:44.802879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.804293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.807722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:44.816150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 290/588] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/role_assignments?user.id=90ff1707eb264477b0a120e10c5d7a63&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:44.816150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:44.935746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11b2e-32ec-431a-a02c-c8661ee1ce89 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.936635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efb7e-c0c0-4180-bff9-516711c4178a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:44.977507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.978096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.978369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.978633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.979055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78aabd-8982-4667-9949-13741469358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:44.979737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78aabd-8982-4667-9949-13741469358a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:44.980087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78aabd-8982-4667-9949-13741469358a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:44.980428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78aabd-8982-4667-9949-13741469358a None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:44.981513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78aabd-8982-4667-9949-13741469358a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:44.982570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78aabd-8982-4667-9949-13741469358a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.984149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78aabd-8982-4667-9949-13741469358a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.987851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:44.989457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:44.999367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 299/589] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:45.000357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78aabd-8982-4667-9949-13741469358a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:45.002494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:45.004453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:45.006674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 291/590] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:45.012376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.055364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.092201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.142692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88334cb-ecc3-4859-8e6f-f021022293b2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.146476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78aabd-8982-4667-9949-13741469358a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.184890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.185565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.185905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.186096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.195853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.197492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.197953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.198805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.199570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.200747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.201670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:45.202180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.203903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:45.210036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:45.211019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:25:45.211973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:45.216452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 292/591] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:45.217461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.223023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 300/592] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:45.229169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.338903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8004cdc-330c-4d5a-8943-e5862177ea46 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.353294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.366127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f4573-4a35-475f-81bb-06cf38499771 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.367104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.393574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.394250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.394550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.394753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.395481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:45.395778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.397811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.412789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.413791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.414294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.414769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.415686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:45.416197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.418875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.421358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 293/593] 10.222.0.64 () {56 vars in 1139 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:45.422418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.443163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 301/594] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:45.444355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.548720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a417a9-fc48-4ba4-b110-ff294e064c49 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.557603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452c89-ec8a-449d-a4c6-abf8f7405d51 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.594873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.595853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.596448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.596580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.597658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.597943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.598115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.598535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.605906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.607672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.610294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.612122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:45.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:45.621344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:45.622255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:45.629866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:45.631000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:45.631904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:45.631904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:45.631904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:45.632767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 294/596] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:45.633997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.634508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 302/596] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:45.635689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.638784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.683640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.751314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3acf5-555b-4229-9f14-20ba0e6f322e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.774276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffebbe-91f5-4627-aa3e-dcc2e99adbf5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.794335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.795095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.795474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.795910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.807313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.808871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.822240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.823535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.824011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.824435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:45.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:45.826247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:45.827239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:45.827239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:45.827239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:45.827600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:45.828036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:45.829583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:45.830409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 295/597] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:45.832718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.851867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 303/598] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:45.851867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:45.917335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.956038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:45.959592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cbc45-1a57-4f00-9fce-54beb81f2f1c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.968714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052765e-6c5b-4ba8-8f0e-6cd2bd683f51 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:45.996291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:45.997202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:45.997496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:45.997869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:45.998687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:45.999052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.000777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.013934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 304/599] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:46.014805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.015568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.016330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.016763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.017184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.018353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:46.020404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.022009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.044235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 296/600] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:46.044235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.125976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b952f3f-d0b3-45e8-be7b-cb6e359cbdf3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.150533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:46.165501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.166547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.166833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.167107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.173290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1893e-f012-4f8e-ae6f-fb2b91ec77b4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.175831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.177989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:46.200228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:46.201181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:46.202124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:46.205532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 305/601] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:46.207160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.220860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.221529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.221804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.222114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.230058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.231672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:46.245977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:46.246938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:46.247829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 297/602] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:46.248319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.264547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:46.346485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32f909-448b-4205-bf9e-442d88f8345e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.363849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7203082-03bd-4f9d-a89f-18d1f1daad31 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.393880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.395154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.395659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.396411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/d02a5e02723a4c29ad8872f269138453/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.401846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.402440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.402716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.402985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.403663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:46.403961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.405406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.417413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=d02a5e02723a4c29ad8872f269138453, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.419428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.424681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 298/603] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:46.425731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.500639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 306/604] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:25:46 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/d02a5e02723a4c29ad8872f269138453/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:46.502038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.502998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:46.569058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:46.583591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839db20-8e65-4f44-bbfd-f282ce940def None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.655179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.655853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.656135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.656404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.657223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:46.657550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.659388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.674582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 299/605] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:46.683884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:46.713699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7cab-b41e-4f6a-b077-f0199899e16b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.753196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175ba7-46d0-452a-947f-315d53d84c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.754274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175ba7-46d0-452a-947f-315d53d84c9e None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.754795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175ba7-46d0-452a-947f-315d53d84c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.755543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175ba7-46d0-452a-947f-315d53d84c9e None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f342c15c234b4d6592404de7e7bee866/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.774889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22175ba7-46d0-452a-947f-315d53d84c9e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=f342c15c234b4d6592404de7e7bee866, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.776466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22175ba7-46d0-452a-947f-315d53d84c9e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.805235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d250-e84f-4561-8fbe-d8d28563d149 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:46.835605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:46.841997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5b078-f9d0-4693-9563-6522ca28f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:46.842714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5b078-f9d0-4693-9563-6522ca28f836 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.842930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5b078-f9d0-4693-9563-6522ca28f836 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.843202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5b078-f9d0-4693-9563-6522ca28f836 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/3f69a6b87a274ca3b4d658080992abb0/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.858754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5b078-f9d0-4693-9563-6522ca28f836 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=3f69a6b87a274ca3b4d658080992abb0, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:46.860194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5b078-f9d0-4693-9563-6522ca28f836 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:46.885305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 307/606] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:25:46 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f342c15c234b4d6592404de7e7bee866/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:46.885305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd980b-d93e-4282-824d-cfb5cb8fcd45 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.885305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd980b-d93e-4282-824d-cfb5cb8fcd45 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.885305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd980b-d93e-4282-824d-cfb5cb8fcd45 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.889184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 308/607] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:46.891101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9aefc-4bba-476e-8bcd-d45938f1c9c5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:46.891467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9aefc-4bba-476e-8bcd-d45938f1c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:46.891732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9aefc-4bba-476e-8bcd-d45938f1c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:46.913194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-98c9aefc-4bba-476e-8bcd-d45938f1c9c5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:46.914450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-98c9aefc-4bba-476e-8bcd-d45938f1c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:46.938788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 300/608] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:25:46 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/3f69a6b87a274ca3b4d658080992abb0/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:47.006958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 309/609] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:47.213122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9930a-64d2-42f2-9ca8-c38128aa935a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:47.213510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9930a-64d2-42f2-9ca8-c38128aa935a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:47.213723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9930a-64d2-42f2-9ca8-c38128aa935a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:47.215262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 301/610] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:47.220738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:47.221192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:47.221306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:47.240351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:47.241549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:47.249665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:47.297843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9930a-64d2-42f2-9ca8-c38128aa935a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:47.317310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 310/611] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:47.432679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9930a-64d2-42f2-9ca8-c38128aa935a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:47.477027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:47.477606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:47.477876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:47.478142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:47.494912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:47.499628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:47.500563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:47.501463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:47.502124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 302/612] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:47.507904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:47.645632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a831e-5282-4092-a5be-f2dbfc605cde None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:47.694069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:47.694688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:47.695050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:47.695260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:47.695878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:47.696176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:47.697567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:47.706815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 311/613] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:47.711476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:47.712580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:47.717548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:47.797441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:47.829332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415455d-16ed-4c68-bcee-ac016b0ca8c8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:47.868617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9535-cd65-416e-aa64-e515bc4cc4b0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:47.890252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:47.890891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:47.891173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:47.891448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:47.908518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:47.910680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:47.920643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:47.921299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:47.921578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:47.921850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:47.939625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:47.943413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:47.944331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:47.944331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:47.944331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:47.947451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:47.953375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 312/614] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:47.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:47.957723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:47.959787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 303/615] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:47.964046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:47.966124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.041557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:48.126436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcddd56-5e33-493e-ab6e-03279253e1ab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.175346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:48.181587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49fd56-9e8d-4350-88f2-2e8011b67ee8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.190943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.191550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.191826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.192096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:48.192733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:48.193032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:48.196186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:48.221385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 313/616] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:48.224674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.248999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.249632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.249910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.250180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:48.250839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:48.251136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:48.252500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:48.261946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 304/617] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:48.267921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.422410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bb6eb-df02-4b8e-93d7-19661acbeef2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.453564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:48.461230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a8644-f450-4c69-9dec-46dbaa792e9a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.488376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.489005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.489300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.489568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:48.501829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:48.504127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:48.520324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.520957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.521252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.521529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:48.525600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:48.526708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:48.527761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:48.528881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 314/618] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:25:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:48.536090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.553468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:48.554928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:48.583108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:48.584237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:48.585126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:48.585126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:48.585126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:48.594373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 305/619] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:48.595244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.626083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:48.739575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4175b0-e7bc-4d20-91b6-8a03d09d757e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.780705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.781349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.781630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.781905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:48.782630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:48.782935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:48.784409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:48.790694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5d7f-e01e-40af-8592-cf9357764fd8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.803020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 315/620] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:25:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:48.808538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.846513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:48.866955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.872898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.872898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.872898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:48.872898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:48.872898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:48.872898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:48.905681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 306/621] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:48.914234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:48.926437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ea21-6ff5-427f-9691-3d913ae93a4f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:48.961553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b39b07-cf52-4812-aaf4-118a1c2cedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:48.962161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b39b07-cf52-4812-aaf4-118a1c2cedda None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:48.962445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b39b07-cf52-4812-aaf4-118a1c2cedda None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:48.962720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b39b07-cf52-4812-aaf4-118a1c2cedda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.029696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.034098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b39b07-cf52-4812-aaf4-118a1c2cedda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.035820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b39b07-cf52-4812-aaf4-118a1c2cedda None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.042186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d614b-aecc-4b94-9d17-ad89445e629c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.070091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.081875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.082510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.082781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.083052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.091244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.093564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d13b5c19-8588-45cd-8700-9bc28022fbd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:49.106968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:49.107941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:25:49.108867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:49.113839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 307/622] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:49.115274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6b4e-f158-459c-82bd-ee6f64041c45 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.115558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6b4e-f158-459c-82bd-ee6f64041c45 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.115819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6b4e-f158-459c-82bd-ee6f64041c45 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.117485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 308/623] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:49.118287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6b4e-f158-459c-82bd-ee6f64041c45 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.145809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 316/624] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:25:49.147110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.147397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.147668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.166450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:49.167714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:49.234481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6b4e-f158-459c-82bd-ee6f64041c45 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.239565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 317/625] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:49.240425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.279924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.280446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.280719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.280987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.281838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:49.282137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.283647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.285989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.303557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 309/626] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:49.310659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.362517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.425700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983557-297f-45c4-b06a-ca0e045fd048 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.454715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f934ec5-a292-483c-bb4e-827e09fdc32d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.462988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.463994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.464469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.464930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.476573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.478411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.494779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.495405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.495732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.496002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-74f26d50-430d-4476-bcc3-1c54d2aa9de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:49.496809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:49.497809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:49.498696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:49.498696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:49.498696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:49.500993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 310/627] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:49.507258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.508022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2143b-d2ac-4942-b6b7-a373b98825e5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.508587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2143b-d2ac-4942-b6b7-a373b98825e5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.508849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.509363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2143b-d2ac-4942-b6b7-a373b98825e5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.511865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 311/628] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:49.515486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2143b-d2ac-4942-b6b7-a373b98825e5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-19717e22-4138-44af-8384-21b7af914d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:49.528761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:49.529995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:49.531365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:49.531365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:49.531365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:49.531365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 318/629] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:49.531735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.531735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.532130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.552626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:49.554064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:49.585345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.632150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 319/630] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:49.633059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.653868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2143b-d2ac-4942-b6b7-a373b98825e5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.690057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.703890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.705057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.706410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.707262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.708278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:49.709138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.711016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.734223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 312/631] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:49.735116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.756556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1719cd-c4e3-4d46-a2b2-e73f4b213544 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.795482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.796308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.796842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.797116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.797925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:49.798226 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.800687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:49.818617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 320/632] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:49.818617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.840224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13269-db0b-4f4b-ad8f-4a47f86933b3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.842558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.874597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34740-d3ea-4b5d-aa5d-a8fe1ace7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.875658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34740-d3ea-4b5d-aa5d-a8fe1ace7f2b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.875658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34740-d3ea-4b5d-aa5d-a8fe1ace7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.875957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34740-d3ea-4b5d-aa5d-a8fe1ace7f2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.888265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c34740-d3ea-4b5d-aa5d-a8fe1ace7f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-52c34740-d3ea-4b5d-aa5d-a8fe1ace7f2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:49.894075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:49.895030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:49.895895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 313/633] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:49.896984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127fb0-e00a-49ae-b868-b7b60d7a14d3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.896984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127fb0-e00a-49ae-b868-b7b60d7a14d3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.896984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127fb0-e00a-49ae-b868-b7b60d7a14d3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.901280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 314/634] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:49.901280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127fb0-e00a-49ae-b868-b7b60d7a14d3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:49.948017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898ddf9-0d40-46c7-9b81-cae6cdfe0b53 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:49.954786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:49.981822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:49.982440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:49.982711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:49.982989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:49.990548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:49.991989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.000872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127fb0-e00a-49ae-b868-b7b60d7a14d3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:50.003815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:50.005020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 321/635] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:50.005991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.035774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.036386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.036657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.036922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.043379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.044794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9c697927-9144-40a2-bfcd-489a0a189a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:50.055693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:50.056647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:50.057608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 315/636] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:50.058229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.058496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.058693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.076382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:50.077635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:50.095479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.114094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0e14d-9a40-4b35-a0c9-ac408a3dc349 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.145672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 316/637] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:50.146500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.151921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.152685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.153119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.153570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.154763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:50.155206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.157064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.168260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 322/638] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:50.169424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.207588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.245978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fc75a-6c7c-458f-b5bc-f665128b6aa3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.282302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.282495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29695c8d-3275-425c-88e1-42efc9226f2d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.282946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.283254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.283508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.296222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:50.302618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:50.303543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 317/639] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:50.306029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.320625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.321240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.321524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.321793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.322461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:50.322759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.324244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.325544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.336847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 323/640] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:50.337669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.423645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1a3a2-3f1c-4b78-8016-7a5e6b611ab3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.428753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.440616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac43069-1baf-4559-96ad-fe76972481a0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.458817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.459423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.459698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.459963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.460640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:50.460941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.462400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.474118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 318/641] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:50.474434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.474903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.475071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.475314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.475576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.488649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.490111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:50.504481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:50.510567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:50.511739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:50.511739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:50.511739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:50.511739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 324/642] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:50.511739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.552107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.576480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a16a68-1427-4219-a247-ea8d0a8cf083 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.609989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.610730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.611104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.611337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac342ae-3878-4807-8ceb-e05363a715dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.611557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.612481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:50.612888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.614363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.623073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 319/643] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:50.623953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.652815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.653491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.653770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.654044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/90ff1707eb264477b0a120e10c5d7a63/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.664991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.668828 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=90ff1707eb264477b0a120e10c5d7a63, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.670307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.722573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d194-7327-45d5-82b4-37920643474b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.755228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.755836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.756107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.756371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.759033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:50.761135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 325/644] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:25:50 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/90ff1707eb264477b0a120e10c5d7a63/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:50.761971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.778561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:50.783798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:50.784875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 320/645] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:50.790468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.887480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f9049-e327-4d99-8e29-62cea8630399 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.907706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a9904-d3d7-4924-88b6-67c4451622d5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:50.927957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.928560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.928987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.929283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.930188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f354bf4e63d949ecbb86b123a7022293) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:50.930386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.931791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.940618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 326/646] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/role_assignments?user.id=f354bf4e63d949ecbb86b123a7022293&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:50.941591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:50.959045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:50.960364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:50.960842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:50.961601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:50.962847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:50.962847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:50.964045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:50.979232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 321/647] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:50.979932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.023341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.058654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.091203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a390c3f-c6a4-42ac-af61-1c90ab95f3dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.119517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bedf7-1c10-4d4d-9fdd-4a1c726e4794 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.138592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.139289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.139575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.139851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.154017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.155812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.162942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.163655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.163939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.164207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.164864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:51.165162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.166554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:51.172509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:51.173494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:51.175073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:51.175073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:51.175073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:51.175073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 327/648] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:51.176205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.183409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 322/649] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:51.184758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.302500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7a2ce-af2c-48a8-9750-d3a803e291fd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.308002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4df34c-c478-4bf4-8765-13353519a5e8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.309647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.335761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.338368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.339002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.339277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.339546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.346018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.346917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.347901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.348369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.348474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.349441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:51.349942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.350045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.352155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:51.362661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:51.363644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:51.365061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 328/650] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:51.365693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.369295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 323/651] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:51.371727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.483306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945ccc5-1797-4f70-9c10-f41230d51569 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.486975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4aadc-df27-46ab-8de1-99afcc65a386 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.521547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.522152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.522422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.522687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.523402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:51.523954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.525324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.538787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.539775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.540887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.541416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.548646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 324/652] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:51.548646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.561892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.563350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:51.581037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:51.582127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:51.583127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:51.583127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:51.583127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:51.586694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 329/653] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:51.587558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.608506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.617626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.685503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7389e5-e817-43f7-89b8-143fa9d6e7bb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.695331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed0cac-3c99-461a-9b7b-d63d604f28b5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.733483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.733995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.734268 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.734532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.736327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.737697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.738982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.739473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.748421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.750830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:51.769930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:51.770939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:25:51.771928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:51.775011 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 325/654] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:51.776061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.812103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.813739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.833249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.915043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49936b4-5840-4ba0-91f8-800aa094fa69 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.933575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 330/655] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:51.934415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.934994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.954715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.956096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.956247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.956473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.957102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:51.957437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.958781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.976289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 326/656] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:51.977173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.063801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc3fd-35c8-41bc-a1ee-af7b34619e37 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.083042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.096306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02eff-a374-496e-af70-7c5065bd92c1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.101020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.101843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.102282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.106650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.106650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:52.106650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.106650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.130647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 331/657] 10.222.0.64 () {56 vars in 1139 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:52.132044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.137991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.138629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.138906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.139172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.151723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.153174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:52.171293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:52.172253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:52.173161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:52.173161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:52.173161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:52.173161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 327/658] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:52.173161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.187076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.259755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca30fb-a833-45ee-a23c-c9cc0a44762a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.292764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44b9f-b622-4996-9ed2-de6966d66c7b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.304205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.305710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.305991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.306260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.316117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.318417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.333041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.333668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.333943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.334217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:52.335076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:52.336002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:25:52.336977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:52.343944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 332/659] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:52.343944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.388428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.424532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.426629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.441345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.466417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872261-47db-4fd0-9480-b9d9b66a559d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.502966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.503730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.504437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.504581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.505165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:52.505555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.506858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.524450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 333/660] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:52.525386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.563376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 328/661] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:52.565062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.647689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.653701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e4cb-74c4-4348-b438-2cb25cbf66c5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.689678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.690528 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.690788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.691061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.691777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:52.692078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.693582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.695585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3900-186a-44f4-9f0d-e1e1d2403dc0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.707868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.712666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 334/662] 10.222.0.64 () {56 vars in 1137 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:52.713624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.737945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.738811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.739523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.740402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.750014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.751690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:52.766134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:52.767234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:52.769241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:52.771274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 329/663] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:52.772244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.838925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d593b5-ecfd-4842-8c93-e97324972454 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.883305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.884807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.885392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.885921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.887506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb877384-5359-45a7-b902-9686e429f05e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.902908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.904911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:52.922146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:52.923391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:52.925075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:52.925075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:52.925075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:52.929088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 335/664] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:52.945808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.945959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de03144-2c79-4456-88c8-a473ba68907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.945959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de03144-2c79-4456-88c8-a473ba68907b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.945959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de03144-2c79-4456-88c8-a473ba68907b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.945959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de03144-2c79-4456-88c8-a473ba68907b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.946645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:52.992954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.041889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de03144-2c79-4456-88c8-a473ba68907b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.043388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de03144-2c79-4456-88c8-a473ba68907b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.047746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c559c4-2f4e-4a60-afdb-a987ef29f1b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.084254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.084847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.085136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.085671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.086109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:53.086412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.087835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.099998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 336/665] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:53.100927 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.171089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 330/666] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:53.171089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001877-6847-4350-b986-13ad9c2f33d4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.171089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001877-6847-4350-b986-13ad9c2f33d4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.171089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001877-6847-4350-b986-13ad9c2f33d4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.171089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 331/667] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:53.171089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001877-6847-4350-b986-13ad9c2f33d4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.172351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.209529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a498-b862-4aa6-9362-a2e5d4fd8ccc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.245095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.246537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.247321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.247721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.247941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.248574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:53.248876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.250280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.268167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 337/668] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:53.268167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.289967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001877-6847-4350-b986-13ad9c2f33d4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.329048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.329664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.330486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.330898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.331722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=d02a5e02723a4c29ad8872f269138453) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:53.332184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.333690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d8a75-4b79-49c3-91cc-a7623f98faed None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.349252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 332/669] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/role_assignments?user.id=d02a5e02723a4c29ad8872f269138453&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:53.349252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.349252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.349252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.367597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:53.368942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:53.390509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877da61-2ada-4588-964f-a58a2a02d067 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.419801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.429393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.429940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.430242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.430572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.444423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.445978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.448606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 333/670] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:53.449275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-70c7246a-0fed-4109-b446-c23eea7898dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:53.471113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:53.472196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:53.473102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:53.473102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:53.473102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:53.473102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 338/671] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:53.477309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc8b6-bfc9-4606-b9d6-7eb90f9f8018 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.477309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc8b6-bfc9-4606-b9d6-7eb90f9f8018 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.477309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc8b6-bfc9-4606-b9d6-7eb90f9f8018 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.477309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 339/672] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:53.477837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc8b6-bfc9-4606-b9d6-7eb90f9f8018 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.533113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.583590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e61a1-9877-4135-97a0-ec2db533f5e5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.607195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc8b6-bfc9-4606-b9d6-7eb90f9f8018 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.634545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.635435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.635724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.635989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.644613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.645491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.646084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.646320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.646741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.647104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.647834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:53.648289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.649846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-dc048113-63b9-40de-b69b-1df851344c8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:53.659365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:53.660433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:53.661525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 334/673] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:53.664431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.664431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.664431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.669343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 340/674] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:53.670296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.694652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:53.696378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:53.714819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.779184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd01cd-3ec2-44a6-9c96-717d44c1a21f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.785278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 335/675] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:53.788777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.816406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.817003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.817317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.817587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.818317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:53.818614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.820091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.836846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 341/676] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:53.836846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.864899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.937616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf092a3-29d9-4593-8f9d-5e7c3d444b9d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.947554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:53.951721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc00d8-b8d3-43e0-8a36-04483e56753c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.978795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.980003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.980468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.980875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.987276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.988049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.988420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.988783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.990272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.991865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.001011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:54.005696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:54.006598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:54.007520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:54.007967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:54.009090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:54.010104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 342/677] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:54.010999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.012356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 336/678] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:54.014311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.118516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3b61a-987d-483c-aa8e-064bdc4d74fe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.125147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f12454-3115-4af6-b08d-8021fca5d5f2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.139919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:54.153423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.154110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.154386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.154741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.155452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f342c15c234b4d6592404de7e7bee866) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:54.155749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.157162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.162506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.174135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 343/679] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/role_assignments?user.id=f342c15c234b4d6592404de7e7bee866&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:54.174375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.174375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.174375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.174617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.174702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:54.174702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.174702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.184689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 337/680] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:54.185838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.202031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:54.313989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee507c27-e4cf-4323-bd94-2994e451e577 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.314643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e7673-de34-4c42-9422-f82f999c1269 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.355907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.355907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.356210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.356319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.363908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.364826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.365424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.365705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.366407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:54.366704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.368430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.369073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:25:54.374519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:54.375444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:25:54.376302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:54.379394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 338/681] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:54.380385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.382404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 344/682] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:54.386315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.422419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:54.500223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:54.508021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd76f-fbac-4580-a4d7-fdf8e52ed395 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.523745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a86a4-a54a-44c9-9091-251fc22f76a4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.553057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.553976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.554260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.554783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.568711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.569308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.570061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.570193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.570413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.570752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.571469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:54.571829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.573918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.584870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 345/683] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:54.585885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:54.590441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:54.591596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:54.592711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:54.592711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:54.592711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:54.597260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 339/684] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:54.597260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.696044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebed4d-a850-4414-a159-d9b5f9a69cd1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.698167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:54.715065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeda24a-3227-4029-a056-aed64a8476b8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.731243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.731842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.732121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.732395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.733110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=3f69a6b87a274ca3b4d658080992abb0) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:54.733837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.735151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.741779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 346/685] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/role_assignments?user.id=3f69a6b87a274ca3b4d658080992abb0&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:54.742855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.763563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:54.771192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.772104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.772574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.772984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.794254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.801667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:54.832932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:54.834193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:54.835340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:54.835340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:54.835340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:54.836976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 340/686] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:54.843312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.860401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8440ce0-c52e-4762-ac96-0c00d186e760 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:54.915011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:54.916281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:54.916637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:54.916973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:54.917659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:54.917959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:54.919881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:54.936363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 347/687] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:54.944126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:54.977157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384356-bc18-4288-b1bc-d72361ff898e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.018862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.020145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.020884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.021322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.022552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:55.023232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.024918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.030574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.034837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.041150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 341/688] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:25:55.046799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.073344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeccd1-598d-41c4-b360-f6583d8047de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.125007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.126028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.126471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.126854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.138249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.140706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:55.163082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:55.164120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:25:55.165074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:55.168452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 348/689] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:25:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:55.171444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.190458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d4b1b-95b4-4be0-b2fe-53f88ca80a11 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.238987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.239881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.240168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.240440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.250839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.254683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:25:55.270413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:55.271402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:25:55.272365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:55.276277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 342/690] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:55.277987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.299776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a62a-a337-4f0d-b86b-72fb262d0902 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.336208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.347393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.348548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.349174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.349497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.351864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.351864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:55.351864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.353267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.377346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 349/691] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:55.384433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.406932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ef12-0b3c-42b3-9ee4-0b43463740ec None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.481544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.482186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.482451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.482717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.483443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:55.483739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.485167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.504386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f6bfd-a7f1-47c0-a993-8de6b153bfa9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.522943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 343/692] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:55.528299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.547088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95b72c-0793-49a3-a219-18e947a48468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.548863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b72c-0793-49a3-a219-18e947a48468 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.549930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b72c-0793-49a3-a219-18e947a48468 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.550408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b72c-0793-49a3-a219-18e947a48468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.617155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.631882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b72c-0793-49a3-a219-18e947a48468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.633558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b72c-0793-49a3-a219-18e947a48468 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.716862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553299-ac90-4934-89b5-514f058cf915 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.734425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.744881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 350/693] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:25:55.747906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094a90-be3b-4611-bb9b-444b2008ea70 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.748191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094a90-be3b-4611-bb9b-444b2008ea70 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.748464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094a90-be3b-4611-bb9b-444b2008ea70 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.750576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 351/694] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:55.752705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094a90-be3b-4611-bb9b-444b2008ea70 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.765751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c19da-2956-45f6-8842-b7bf0c170e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.766735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c19da-2956-45f6-8842-b7bf0c170e01 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.767595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c19da-2956-45f6-8842-b7bf0c170e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.767930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c19da-2956-45f6-8842-b7bf0c170e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.847395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c19da-2956-45f6-8842-b7bf0c170e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.848773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c19da-2956-45f6-8842-b7bf0c170e01 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.865547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:55.885884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094a90-be3b-4611-bb9b-444b2008ea70 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:55.929813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:55.930672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.931091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.931502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.945408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:55.947304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:55.968437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 344/695] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:25:55.968437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:55.968437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:55.968437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:55.972521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:55.973666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:55.974784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:55.974784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:55.974784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:55.981783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 352/696] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:25:55.982580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:55.989258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:55.990466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:56.002705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.069596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 345/697] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:56.070529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.136094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e5206-0e4e-46d0-9aef-aefd8baa2104 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.199937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.200626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.200908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.201183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.209432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.215069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.216945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.244173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42205ce6-d7f9-475e-b92a-3341d3fc3193 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:56.248656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:56.249878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:56.250868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:56.250868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:56.250868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:56.257884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 353/698] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:56.266143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.290163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.290848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.291023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.291296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.292007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:56.292323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.293717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.310214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 346/699] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:56.311355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.324773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.426015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd652013-0e52-42f2-8061-e68ccbb8764a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.434536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e88af-087d-4be0-854d-dc40cfae1676 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.470834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.471210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.471467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.471747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.471845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.472045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.472148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.472300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.472648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:56.472994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.474423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.480416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.482556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.487668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 354/700] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:56.488517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:56.498467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:56.499547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:56.500465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:56.501620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 347/701] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:56.505251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.544058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.595283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.605528 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7a135-245f-496e-a620-f02cbb4ec0e8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.642567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca39b0-5f95-42d9-85cc-c2cd78862be0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.650409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.651729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.652115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.652552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.653300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.655284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:56.671778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:56.672862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:56.673834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 355/702] 10.222.0.64 () {56 vars in 1129 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:56.674657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.687477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.688354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.689591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.689873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.700807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.702329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:25:56.714645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:56.715624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:56.716528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 348/703] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:56.717020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.819447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833cee9-3421-4dad-b54a-90dcc338feb9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.832026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8883ca-87bb-4537-898b-b45c9fa1e575 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:56.838032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.859441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:56.864147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.864604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.864883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.865176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.866005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:56.866245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.867683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4209e-430f-4fb1-9eef-42f7233e4d6a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.869417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:56.870024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.870299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.870572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.871190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:56.871489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:56.872855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:56.877730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 349/704] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:56.878775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:56.886118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 356/705] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:56.887578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4aaf7-543e-45af-aa84-d96e6dbb8085 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.888067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4aaf7-543e-45af-aa84-d96e6dbb8085 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.888531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4aaf7-543e-45af-aa84-d96e6dbb8085 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.890371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 357/706] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:56.891508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4aaf7-543e-45af-aa84-d96e6dbb8085 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:57.000234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4aaf7-543e-45af-aa84-d96e6dbb8085 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.001945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8804af-bca7-4d99-b8e5-2d8e5b5fad8d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.037553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.038490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.038953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.039421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.040179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.040434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:57.040777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.041052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.041350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.041539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.042028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:57.042327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.043466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.043722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1da8-e995-4139-b181-e0625b2e9ec6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.050050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 358/707] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:57.051577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:57.056093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 350/708] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:57.062181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.062464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.062731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.083311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:57.084548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:57.122660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:57.144173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:57.174035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 351/709] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:25:57.175070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:57.203755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606cb92-22ac-4079-86a3-3cdeaf8a4c9e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.245993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.246952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.247372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.247790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.249522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=90ff1707eb264477b0a120e10c5d7a63) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:57.250040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.251828 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.258811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 359/710] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:57 2022] GET /identity/v3/role_assignments?user.id=90ff1707eb264477b0a120e10c5d7a63&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:57.329732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a2cc3-aa69-4f68-924a-2a85f6b8407f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.368885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.369770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.370218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.370688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.371617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f354bf4e63d949ecbb86b123a7022293) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:57.372096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.373711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026252d6-9ca5-49b5-9133-fcbaeaf286fb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.381724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 352/711] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:25:57 2022] GET /identity/v3/role_assignments?user.id=f354bf4e63d949ecbb86b123a7022293&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:57.572025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:57.590723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa139-dc36-47e3-a554-112c4cb4a2c1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.591057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa139-dc36-47e3-a554-112c4cb4a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.591277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa139-dc36-47e3-a554-112c4cb4a2c1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.592929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 353/712] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:57.599453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.599750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.600002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.632855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:57.634461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:57.681993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:57.704976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc865c8-65a5-4354-8251-0508cba91975 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.718712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 354/713] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:25:57.725574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:57.746569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.747192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.747467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.747731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] PATH_INFO: `/v3/services/network` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.748302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.749838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:57.759654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:57.760735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:25:57.761919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 360/714] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:25:57 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:57.768566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:57.877306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f30ca-0a50-48f0-b12d-3906906e3bb6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.925113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.925823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.926097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.926363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.926988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] RBAC: Adding query filter params (name=network) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:57.927283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.928754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.936868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 355/715] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:25:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:57.942710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:58.050274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:58.077113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b2f6-03ee-4262-9db9-4fb02aa80621 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:58.124737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:58.150095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:58.150666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:58.150938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:58.151222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:58.151855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:58.152150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:58.153534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:58.165437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 361/716] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:25:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:58.243973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc3060-9fea-40a4-9dc2-3e67ba276820 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:58.299593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:58.300655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:58.301135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:58.301632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:58.319452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:58.321318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:25:58.344217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:25:58.345839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:25:58.346857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:25:58.346857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:25:58.346857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:25:58.348831 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 356/717] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:25:58.355194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:58.405806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:58.483450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127796f-f82a-464e-ab34-d79f111269c3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:58.522914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:58.523794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:58.524064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:58.524326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:58.524952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:25:58.525262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:58.526632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507fae6-94f8-4ffc-b78f-429f1dfa57d5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:58.542868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 362/718] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:25:58.548864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:58.692282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:58.702613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48cd5-1005-4f4d-84e0-d7ea04c47048 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:58.748012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e08b-f7df-499d-925d-b1d543313143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:58.748905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e08b-f7df-499d-925d-b1d543313143 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:58.749391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e08b-f7df-499d-925d-b1d543313143 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:58.749841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e08b-f7df-499d-925d-b1d543313143 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:58.750767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e08b-f7df-499d-925d-b1d543313143 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:58.752374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e08b-f7df-499d-925d-b1d543313143 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:58.834113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 357/719] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:25:58 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:25:59.506095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68cde0-17ce-41a5-8912-38ccf54b2337 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:59.506805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68cde0-17ce-41a5-8912-38ccf54b2337 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:59.506805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68cde0-17ce-41a5-8912-38ccf54b2337 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:59.507938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 363/720] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:59.513900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f396-f1ef-43ab-97d4-ecdf72db3003 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:59.514400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f396-f1ef-43ab-97d4-ecdf72db3003 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:59.514500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f396-f1ef-43ab-97d4-ecdf72db3003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:59.539250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-11f0f396-f1ef-43ab-97d4-ecdf72db3003 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:59.540484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-11f0f396-f1ef-43ab-97d4-ecdf72db3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:59.644874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 358/721] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:26:00.090719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68cde0-17ce-41a5-8912-38ccf54b2337 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:00.160775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ca8a-0ab6-4048-9944-367953dc7883 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.161130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ca8a-0ab6-4048-9944-367953dc7883 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.161354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ca8a-0ab6-4048-9944-367953dc7883 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.163043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 359/722] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:00.168180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b103-7a1c-4f30-aeae-6976148fc0a9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.168464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b103-7a1c-4f30-aeae-6976148fc0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.168734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b103-7a1c-4f30-aeae-6976148fc0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.198907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-87c2b103-7a1c-4f30-aeae-6976148fc0a9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:00.200121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-87c2b103-7a1c-4f30-aeae-6976148fc0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:00.226453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:00.237476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68cde0-17ce-41a5-8912-38ccf54b2337 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:00.281023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:00.281787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.282137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.282412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.283085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:00.289243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 360/723] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:26:00.289385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:00.291168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711dbb3-9b03-4832-9226-06738b8a704a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.291507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711dbb3-9b03-4832-9226-06738b8a704a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.291775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711dbb3-9b03-4832-9226-06738b8a704a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.293261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 361/724] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:00.299383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.299865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.300353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.314258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:00.321318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:00.322874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:00.395309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 362/725] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:26:00.421265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 364/726] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:00 2022] POST /identity/v3/services => generated 251 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:00.564847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:00.701828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166391d5-5de6-4b5c-a91a-7c4451c9ec23 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:00.714366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:00.749385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:00.756466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:00.757107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.757416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.762374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.774066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:00.779264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:00.780244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:00.781200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 363/727] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:00.786550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:00.846838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df99ee-6724-48e5-bcf8-c6f708a1ad99 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:00.885655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:00.886621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:00.887135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:00.887611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:00.901374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:00.907846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:00.908864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:00.909766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:00.913267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 365/728] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:00.925629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:00.949026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:00.984319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9e637-9d71-4ff9-bba4-abbbd1d669dc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.059045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.059665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.059937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.060198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.060864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:01.061158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.062582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.076017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 364/729] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:01.082175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.115227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d709f-e846-4e4f-aa29-00994feeb8da None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.171615 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:01.173767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.174650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.174932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.175204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.176024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:01.176327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.178339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bd0ee-d9b2-4fe8-86a4-bb8b186f68f2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.191198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 366/730] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:01.192444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798324-8196-46b3-853e-d7af6ea6bb0a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.193191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798324-8196-46b3-853e-d7af6ea6bb0a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.193580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798324-8196-46b3-853e-d7af6ea6bb0a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.198846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 367/731] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:01.200346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798324-8196-46b3-853e-d7af6ea6bb0a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.227778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e87b-ec49-487b-889a-ec1e3e14126a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.264292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.264935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.265206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.265495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.277610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.279281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.287697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-954444aa-cef9-482f-92df-450e6fdcff4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:01.295353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:01.301962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 365/732] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.302872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.319170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:01.320566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:01.333516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798324-8196-46b3-853e-d7af6ea6bb0a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.372243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.373377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.373881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.374372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.387861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.389829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.397257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 366/733] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:26:01.397257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:01.419436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:01.420454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:01.421399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:01.421399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:01.421399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:01.423515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 368/734] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:01.429582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.432696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:01.499913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80754-815a-4ec0-b9f5-e741da6be3d0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.535557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.541235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.541235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.541235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.541235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:01.541235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.541235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.552530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 367/735] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:01.561748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.665570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:01.670957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4620-0fde-4400-810c-17a16cb6836f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.701682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25464615-769a-4fc6-a9ac-5cc3a91cf45f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.717461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.718109 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.718383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.718649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.728355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.729900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:01.744036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:01.745065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:01.746116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:01.746680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 368/736] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:01.747225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.749666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:01.756717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.757380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.757718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.757985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.764193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:01.764193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.764193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.781393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 369/737] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:01.782623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.867717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349085b-a07f-460c-b7c9-006e0a9a017f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.887917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70dcca-ff62-4dd1-a885-d2abfd93db0d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:01.903812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cebd7d-8a93-4fcf-8481-c1174c065a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.904777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebd7d-8a93-4fcf-8481-c1174c065a73 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.905260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebd7d-8a93-4fcf-8481-c1174c065a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.905835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cebd7d-8a93-4fcf-8481-c1174c065a73 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.907219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cebd7d-8a93-4fcf-8481-c1174c065a73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.908755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cebd7d-8a93-4fcf-8481-c1174c065a73 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.922914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:01.923688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.929794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.929794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.929794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:01.929794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:01.929794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:01.948907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 370/738] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:01.948907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:01.977194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 369/739] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:01 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:01.986884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c001f-ed5c-402e-9fc4-d35721c870a1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:01.988949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c001f-ed5c-402e-9fc4-d35721c870a1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:01.989554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c001f-ed5c-402e-9fc4-d35721c870a1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:01.993505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:01.994849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 370/740] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:01.996022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c001f-ed5c-402e-9fc4-d35721c870a1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.023456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:02.088835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ae67-896e-4e36-9d56-26c041dc62ad None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.147771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c001f-ed5c-402e-9fc4-d35721c870a1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.148089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.148716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.148993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.149320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.159941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:02.162343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-58b8b9c8-aec1-4fe6-bdbd-fc127cfba366 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:02.180643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:02.181683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:02.182623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 371/741] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:02.183760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.183955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.185002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.194712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.195338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.195612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.195875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.205598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:02.207090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:02.207456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:02.209114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:02.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:02.227678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:02.228784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:02.228784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:02.228784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:02.228784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 371/742] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:02.228784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.297536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 372/743] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:02.299802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.327775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:02.345005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:02.415424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0277-4399-42ee-9ed6-4d9d60cda143 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.470327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122702-74b0-4b5f-93e8-a5ce02ab20f5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.483131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.483741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.484069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.484864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.485620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:02.485916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:02.487340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:02.513431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 372/744] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:02.514777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.544759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.545434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.545709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.547561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.548543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:02.548899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:02.550311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:02.575509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 373/745] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:02.582144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.676267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ced54-d7c0-4c01-96b6-b0f820acdb11 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.706038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:02.713569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:02.720450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.722953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.722953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.722953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.726136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b0ed-0746-4f36-82da-fb68484f9c17 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.774041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.774676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.775029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.775366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.783606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:02.785454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:02.798364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:02.799326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:02.800233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:02.804262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 374/746] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:02.805421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.807978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:02.809678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:02.918395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749689a9-7845-4c18-b2e6-ddb19cc34a78 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:02.919184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 373/747] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:02.920295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:02.949923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:02.959971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:02.960587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:02.960918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:02.961188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:02.974994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:02.980374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:02.981358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:26:02.982241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:02.986777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 375/748] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:02.987799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.032849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.055167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afecd-e5c3-42ba-80d3-7459d1d48055 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.089088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.089711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.089984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.090412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.091057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:03.091356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.092775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.104439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 374/749] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:03.105303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.128458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bffce-89bf-4ea0-b4b6-fb8a408ff371 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.163257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.163866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.164136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.164407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.176145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.177602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ac0e1c9a-9fce-4f25-bd5d-83f411c35360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:03.191618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:03.192608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:03.193558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:03.193558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:03.193558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:03.193558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 376/750] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:03.194602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf99d4-5b23-46b8-a795-0bf8edeb3388 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.194602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf99d4-5b23-46b8-a795-0bf8edeb3388 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.194602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf99d4-5b23-46b8-a795-0bf8edeb3388 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.195695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 377/751] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:03.196189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf99d4-5b23-46b8-a795-0bf8edeb3388 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.206937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.224997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b641f9-afc5-4cab-85ec-2beeef66127f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.260690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.261370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.261650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.261917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.262564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:03.262858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.264194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.264506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.277459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 375/752] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:03.277459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.314826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf99d4-5b23-46b8-a795-0bf8edeb3388 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.349728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bbc39-e2ca-4704-a0ea-c478fff0bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.350385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bbc39-e2ca-4704-a0ea-c478fff0bb18 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.350664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bbc39-e2ca-4704-a0ea-c478fff0bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.350932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bbc39-e2ca-4704-a0ea-c478fff0bb18 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f354bf4e63d949ecbb86b123a7022293/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.352862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bbc39-e2ca-4704-a0ea-c478fff0bb18 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=f354bf4e63d949ecbb86b123a7022293, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.354334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bbc39-e2ca-4704-a0ea-c478fff0bb18 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.383440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565f6fa-036d-4eb5-826b-22836a8e816f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.418705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.419308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.419584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.419852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.420498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:03.421587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.422973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.432417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 378/753] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:26:03 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f354bf4e63d949ecbb86b123a7022293/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:26:03.432417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.432417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.432417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.438409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 376/754] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:03.439376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.443591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.451238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:03.452542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:03.548629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 379/755] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:03.549547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.596330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44b9d-476d-4a4d-b786-cc7e99026fd0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.631418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.659046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.659688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.659966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.660238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.673256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.674783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.689167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810be2f-1641-44c6-8c8a-3819d8fd314c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:03.693867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:03.695172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:03.696094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:03.696094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:03.696094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:03.696094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 377/756] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:03.704002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.736711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.737832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.738328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.738790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.747373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.750400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:03.763999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:03.765010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:03.766035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:03.768561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.769594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 380/757] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:03.775003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.818172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e30448-6eb4-4572-946d-5ee7cc402b68 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.854755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.855537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.855921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.856297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.857041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:03.857464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.859869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.874781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 378/758] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:03.885115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.909516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0d49-b121-4db6-9bfc-08c778fefe2a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.922972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:03.951991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.953440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.954287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.954701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.956426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:03.957042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.959114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.974184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 381/759] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:03.975048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.063364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917a0fb-b88d-4ed9-807e-b54ddc2eabaf None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.085768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:04.094322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de85b2a-20e7-4817-9e57-c2ed47e631f4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.108701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.110499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.110781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.111048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.121073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.123232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.134595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.135503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.135984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.136456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.137371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:04.138026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:04.138975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 379/760] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:04.140526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.142226 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:04.153513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:04.154548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:04.158259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 382/761] 10.222.0.64 () {56 vars in 1129 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:04.159083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.195312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:04.271629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06adea9-783a-4945-85b5-0a0459031a01 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.295936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e5833-e5b7-4bdd-9b4e-234c9fe4dde2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.307634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.308672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.309155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.309694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.310617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:04.311123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.313482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.333840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 383/762] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:04.335082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.344775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.345756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.346281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.346756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.348148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=90ff1707eb264477b0a120e10c5d7a63) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:04.348707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.350962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.358877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 380/763] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/role_assignments?user.id=90ff1707eb264477b0a120e10c5d7a63&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:04.360183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.427685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:04.445435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:04.456898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00559afa-7e86-49f7-837c-fc296a8f82bb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.504170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.505140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.505595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.506023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.506815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:04.507261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.508816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccfa9c-4eda-4c17-bbaf-6611542a77dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.514614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 384/764] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:04.515433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1595-fd94-4259-873f-17564f08e230 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.516969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980e7e-aa0f-42fd-b3a9-0f63f19a0c30 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.517434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980e7e-aa0f-42fd-b3a9-0f63f19a0c30 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.517920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980e7e-aa0f-42fd-b3a9-0f63f19a0c30 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.523978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 385/765] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:04.525237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980e7e-aa0f-42fd-b3a9-0f63f19a0c30 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.564126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.564797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.565079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.565408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.654222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980e7e-aa0f-42fd-b3a9-0f63f19a0c30 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.659882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.661394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.697790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.698737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.699162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.699577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.700531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:04.700978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.703819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a490d3f-f1b5-45a1-9b78-ae3bbb865430 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.709388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:04.709950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 386/766] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:04.711380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.711671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.711942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.736653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:04.737913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:04.756935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:04.786569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 381/767] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:04.787632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.828713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 387/768] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:04.829671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:04.909588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697b42-0c3c-49d2-8aae-f17f3bac6aa2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.960300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:04.960912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:04.961188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:04.961481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:04.962234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] RBAC: Adding query filter params (interface=public, service_id=1ee9a90fbe9f4210968b687af4f5bec9, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:04.962537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:04.963888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:04.977880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 382/769] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/endpoints?service_id=1ee9a90fbe9f4210968b687af4f5bec9&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:04.983509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1033c-f1ec-4434-8bb8-5af39d7b94dd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:04.985754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.000485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:05.051364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.052011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.052269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.052530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.069505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.070966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:05.095840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:05.096857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:05.097848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:05.097848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:05.097848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:05.098545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 388/770] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:05.108223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.114546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:05.183439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece6501-d16a-42f3-b197-1a1e093beb7a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.223033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.223690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.223970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.224236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.224866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.226232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.231477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 383/771] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:04 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:05.232167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.258860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4277-cfd9-428c-be8e-be0b5813e552 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.321634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:05.360911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223453a3-aeef-48b6-8bb4-d07b8f8151ce None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.364497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.364953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.365248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.365525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.366169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:05.366468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.367851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.398945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 389/772] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:05.404152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.404845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.405388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.405947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.406415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] PATH_INFO: `/v3/services/network` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.407196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.408781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:05.420526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:05.422152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:26:05.423047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:05.425897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 384/773] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:05.435538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.524675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:05.584503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7db8b-f3a1-499f-8d07-9281a168814a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.611409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd8e9-fd3f-47dd-afc1-a265ee05677c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.645907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:05.654083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.654689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.654964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.655229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.656500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] RBAC: Adding query filter params (name=network) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:05.657047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.661770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.666126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.666759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.667032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.667299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.676230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 385/774] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:05.677118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.680869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.684096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:05.707565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:05.708564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:05.709485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 390/775] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:05.716033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.806262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7025f-5f55-4eca-bc51-7e1897a1ed83 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.844238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:05.844852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:05.845323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:05.845603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:05.846230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] RBAC: Adding query filter params (type=network) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:05.846532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:05.848060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:05.855234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 386/776] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:05.865450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:05.922941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be61a1-d8f6-4e09-a2a5-05139b7cc858 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:05.969273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:05.978154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:06.004007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641bca-9787-4f74-8463-6f566f532d16 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:06.009925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:06.010545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.010823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.011099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.011855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:06.012163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:06.013907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91087f-ab33-450a-b79b-de8272aca860 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:06.028064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 391/777] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:06.029509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127f66-661a-4ff9-af91-f379a7d22145 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.029794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127f66-661a-4ff9-af91-f379a7d22145 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.030071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127f66-661a-4ff9-af91-f379a7d22145 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.033198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 392/778] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:06.035964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad127f66-661a-4ff9-af91-f379a7d22145 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:06.046272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:06.047119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.047442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.047720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.048417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] RBAC: Adding query filter params (interface=public, service_id=8ec654ad87d74c859813f0cb898ae84b, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:06.048724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:06.050176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6adeb-a566-41dc-bbf8-0866c0869e57 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:06.055938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 387/779] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:05 2022] GET /identity/v3/endpoints?service_id=8ec654ad87d74c859813f0cb898ae84b&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:06.057135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.062230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.062527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.088125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:06.089353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:06.161572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad127f66-661a-4ff9-af91-f379a7d22145 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:06.162302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 388/780] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:06.163216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:06.210024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:06.210983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.211265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.211537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.212511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=cce8fd8a8e2547979eb2df2ad0bc6218) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:06.212820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:06.215006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:06.222349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:06.224574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 393/781] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:06 2022] GET /identity/v3/role_assignments?user.id=cce8fd8a8e2547979eb2df2ad0bc6218&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:06.306302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35fb2-aaab-41fa-acba-474fdd78e9aa None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:06.362823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:06.363454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.363726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.363992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.364603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:06.365999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:06.372816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 389/782] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:06 2022] GET /identity/v3/services => generated 772 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:06.499311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:06.560163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:06.637688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7aa7e-2b5a-459d-bb96-c4757cc3e427 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:06.680660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd316871-e38f-47a2-b3a7-cf7ebe4ee57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:06.681367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd316871-e38f-47a2-b3a7-cf7ebe4ee57b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.681651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd316871-e38f-47a2-b3a7-cf7ebe4ee57b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.681929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd316871-e38f-47a2-b3a7-cf7ebe4ee57b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.694645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd316871-e38f-47a2-b3a7-cf7ebe4ee57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fd316871-e38f-47a2-b3a7-cf7ebe4ee57b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:06.700318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:06.701398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:06.702316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 394/783] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:06.708108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:06.824995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024a0d5-a195-48cd-b01d-f88944dc451e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:06.831883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fb6-9066-41de-a424-436bf9f3b1f9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.832160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fb6-9066-41de-a424-436bf9f3b1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.832427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fb6-9066-41de-a424-436bf9f3b1f9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.833951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 395/784] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:06.839225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.839510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.839785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.845760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:06.861632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:06.863251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:06.876787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:06.878044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:06.879674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:06.880177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:06.881045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:06.882302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:06.883947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:06.899620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 390/785] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:06.901252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:06.996220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 396/786] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:07.049150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07def57-23c5-43f0-a119-efb8bef74812 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:07.092399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:07.093583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:07.094097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:07.094572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:07.106052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:07.107819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:07.128783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:07.134148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:07.135059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:07.135059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:07.135059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:07.138053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 391/787] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:07.143222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:07.191298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:07.275216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d74e-d9b2-4d12-9a1c-a01014ba8702 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:07.303947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:07.339128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:07.340098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:07.340573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:07.341038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:07.341952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:07.342501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:07.344337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:07.358884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:07.365994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 397/788] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:07.373364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:07.489595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:07.498064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661be058-3abc-4eee-be66-199e0872a531 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:07.567078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffa0ad-ea72-4ec9-b4d7-5beef74e14f0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:07.570192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:07.570823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:07.571148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:07.571420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:07.588468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:07.592242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:07.606196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:07.607203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:07.608166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:07.621032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 398/789] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:07.624816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:07.647516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:07.648779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:07.649068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:07.649365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:07.672739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:07.678080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:07.679020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:07.679873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:07.689660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 392/790] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:07.694249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:07.844866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37761-bbd8-445a-9b67-b84ccb8d4dd1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:07.853552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:07.875559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe14b0-a8f4-409a-a92d-97cf77a0e454 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:07.884160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:07.884768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:07.885048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:07.885408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:07.886079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:07.886426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:07.888247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:07.898256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 393/791] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:07.904469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:07.947374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:07.949571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:07.951034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:07.951529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:07.952703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:07.954025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:07.956324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:07.990225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 399/792] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:07.996670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.016195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.125823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cd234-c95f-4d73-b8ea-fab2f8402d6f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.178954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187204-ba83-475d-b338-02d77a7f0a19 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.183918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.184548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.184827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.185097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.195849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.197386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.216317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3643-eb63-4e57-9638-6e83962dbd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.217399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3643-eb63-4e57-9638-6e83962dbd6f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.218422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3643-eb63-4e57-9638-6e83962dbd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.218914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3643-eb63-4e57-9638-6e83962dbd6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.296181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3643-eb63-4e57-9638-6e83962dbd6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.298136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3643-eb63-4e57-9638-6e83962dbd6f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.317653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-67dc1cbc-fb5c-4781-907e-b5dd01ad692f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:08.327755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:08.328748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:08.329701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:08.329701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:08.329701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:08.333364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 394/793] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:08.334838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534fb90-0175-4c30-8d0f-d7d7bc4fe8de None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.337873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534fb90-0175-4c30-8d0f-d7d7bc4fe8de None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.337873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534fb90-0175-4c30-8d0f-d7d7bc4fe8de None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.337873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 395/794] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:08.338568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534fb90-0175-4c30-8d0f-d7d7bc4fe8de None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.353454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.433659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 400/795] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:26:08.435564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.436001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.437158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.459459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:08.460671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:08.472948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534fb90-0175-4c30-8d0f-d7d7bc4fe8de None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.511788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.512444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.512726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.512997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.513675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:08.513973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.515976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.533199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 396/796] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:08.534122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.547965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 401/797] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:08.549175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.599626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.631178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.697805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca19d85-f688-4f73-9a1c-0d8d627bd433 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.727369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a316-ff0c-4982-8e99-e25288c00f37 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.734596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.735228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.735505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.735775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.747151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.748809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:08.764512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:08.765704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:08.766620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:08.766620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:08.766620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:08.766620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 397/798] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:08.774122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.809968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.810607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.810883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.811679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.822591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.824029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c39b7f36-3218-4418-8bb2-ec09c5ebc97d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:08.836788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:08.837834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:08.838872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 402/799] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:08.839937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe914-7731-400a-ab03-d74e61edb0b1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.839937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe914-7731-400a-ab03-d74e61edb0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.840220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe914-7731-400a-ab03-d74e61edb0b1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.846278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 403/800] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:08.847707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.847992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.848259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.868650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:08.869870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:08.902517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd12e1-4cd2-476a-b9f7-58cda434c9eb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.922225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.941657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 404/801] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:08.942166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.942533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.943168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.943617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.944022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.944976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:08.945306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.949834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.961048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 398/802] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:08.962339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.996514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.079526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412131-157f-4378-b4a4-3ec686c2c778 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.085922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74a838-cbea-488b-ba3d-55f52d9b24ff None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.117332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.117951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.118220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.118492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.119213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:09.119515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.120944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aec442-6084-4ae3-ab82-365ca8cd37d8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.122714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.123564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.123949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.124433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.125016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.126391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:09.135570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:09.136586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:09.137489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 399/803] 10.222.0.64 () {56 vars in 1129 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:09.138287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.145374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 405/804] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:09.145374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82458a4-050f-43e7-a3ae-e55556190363 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.145374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82458a4-050f-43e7-a3ae-e55556190363 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.145374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82458a4-050f-43e7-a3ae-e55556190363 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.145374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 406/805] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:09.145374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82458a4-050f-43e7-a3ae-e55556190363 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.192157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.243423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.253414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c410b-f22f-473c-89bc-18b161e27413 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.253827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82458a4-050f-43e7-a3ae-e55556190363 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.287326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.287743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.287950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.288224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.288331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.288491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.288585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.288831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.289464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:09.289761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.291127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.295089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.300473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 407/806] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:09.300473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.300702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-95965a2d-2bba-4fdf-88ff-5183f959445f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:09.309586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:09.310552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:09.311997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 400/807] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:09.312690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.312955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.313254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.330589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:09.331781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:09.395973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d553f-11c8-406f-9f63-a0f1c93fae93 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.397624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 401/808] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:09.398447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.430103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.440659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.441549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.441991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.445410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.453441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.455195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:09.471498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:09.472474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:09.473418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:09.473418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:09.473418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:09.479284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 408/809] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:09.479284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.504331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554304ce-88b6-45b8-bb5f-06fc9258ce14 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.541084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.541754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.542026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.542289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.554345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:09.559160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:09.560305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:09.561742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 402/810] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:09.562438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.615575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.673127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.681718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb2b3-b701-4fe4-af2e-0b761f72315a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.706403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345b181-9c41-4909-9af7-afa5d543a7a9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.715643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.716240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.716524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.716794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.718054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:09.718356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.719784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.731250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 403/811] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:09.732038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.742471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.743065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.743341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.743612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.744227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:09.744525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.745911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.750873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 409/812] 10.222.0.64 () {56 vars in 1124 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:09.751912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.823817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.836477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b32d-714a-4a35-84c1-b506227605cd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.854133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4dbd-9b27-434b-a2a5-3c74251fc954 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.870941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.871538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.871805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.872070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.872695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:09.872990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.874643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.886973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 404/813] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:09.887745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.887924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:09.888569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:09.888854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:09.889780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:09.890324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:09.890618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:09.892134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:09.900171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 410/814] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:09.900958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:09.904140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:09.989135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6908a-64d2-460e-8fa4-341824bb53b6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:09.998189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5acb5-95ae-479d-b457-14dbf2711277 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.023373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.023987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.024255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.024518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] PATH_INFO: `/v3/services/network` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.025079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.026439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.031752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.032334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.032610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.032880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.033621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f354bf4e63d949ecbb86b123a7022293) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:10.033924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.035321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:10.035750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:10.036681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:26:10.037550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:10.038313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.038382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 405/815] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:10.038382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.055164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 411/816] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:09 2022] GET /identity/v3/role_assignments?user.id=f354bf4e63d949ecbb86b123a7022293&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:10.055164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.131375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.156749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821d56a-d0c8-48bd-9355-c39aea8a70ac None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.165161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3e23b-ea2a-4d41-b09c-a7827dee2a26 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.194566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.195174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.195455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.195725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.196405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.197834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.205501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.206848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.207329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.207826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.216279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.218297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:10.230186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:10.234859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 412/817] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:10.235764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.294517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.316228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 406/818] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:10.321513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.339306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc01b-46dd-4dc3-b5e2-b773990644a1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.386517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.387061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.387332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.387631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.410527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.412819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:10.433515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:10.434837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:10.436283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:10.436283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:10.436283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:10.441564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 413/819] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:10.441564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.456492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b68bf-1243-4980-881b-1a9b16c6f38a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.494028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.494622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.495326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.495615 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.495885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.496609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] RBAC: Adding query filter params (name=network) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:10.496914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.499362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.505326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 407/820] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:10.506182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.580210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed828-262a-4303-a218-60a4eae6ccd1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.588960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.633259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.633486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.637115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.637115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.637115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:10.637115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.637115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.637508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb386086-b4a0-4f75-ba72-99d4a9bfc706 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.650440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 414/821] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:10.651433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.673515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.674126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.674402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.674671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.675318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:10.675609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.676969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.694156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 408/822] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:10.695011 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.755486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.761585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebdb6-21d0-4482-a5c2-af2f5d9faee3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.797892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.798750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.799240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.799657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.800460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] RBAC: Adding query filter params (type=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:10.800908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.802493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.803651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69905-c03d-496d-99cd-55fcfb6ea13b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.813539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 415/823] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:10.815338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.843219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.843885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.844188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.844422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/90ff1707eb264477b0a120e10c5d7a63/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.846523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=90ff1707eb264477b0a120e10c5d7a63, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.848064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.849466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.920800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 409/824] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:26:10 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/90ff1707eb264477b0a120e10c5d7a63/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:26:10.921782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.927957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e6d9c-3b93-4044-80e2-5784d61860cd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.978077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.979006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.979438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.979857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.991012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.993777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:11.012298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:11.013534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:11.014559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:11.017295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 416/825] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:11.021182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:11.098022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284bccc-c5cf-4346-b248-1a03ed562359 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:11.133092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:11.177969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:11.179161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:11.179719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:11.180341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:11.181332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:11.183801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:11.203261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:11.214496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9e40-2f93-4eb8-80af-bdb3bded948d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:11.251779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 410/826] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:11.265099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:11.266120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:11.266631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:11.267082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:11.268053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:11.268591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:11.270283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:11.293513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 417/827] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Sep 9 11:26:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:11.300714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:11.447280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d683e-66d2-4146-9b83-840c210bda6b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:11.487277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:11.487976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:11.488256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:11.488520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:11.501587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:11.503141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:11.519748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:11.520760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:11.521701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:11.521701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:11.521701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:11.525299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 411/828] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:11.526878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:11.638922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4995-d234-4425-ba8f-d037e812df8b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:11.676299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:11.676873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:11.677156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:11.677452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:11.678083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:11.678377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:11.679745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:11.692601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 418/829] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:11.698184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:11.737620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:11.825016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f46073-cb0a-479f-97a0-093ec7311f08 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:11.863012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:11.863648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:11.863923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:11.864191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:11.871387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:11.872897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:11.886679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:11.887676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:11.888733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:11.892177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 412/830] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:11.900045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:11.907427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:12.002980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156079-f408-4c92-88c8-46fe84333398 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:12.039233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:12.039836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.040109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.040381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.041057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:12.041383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:12.042808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a3d6e-95e6-4a63-bd43-f00a1239ba53 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:12.060239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 419/831] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:12.063038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:12.159254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:12.175953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e44a1-b136-4390-a00a-f93f7b236990 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:12.211447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10712c-d3fb-474f-a07c-6c42d825dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:12.212105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10712c-d3fb-474f-a07c-6c42d825dbf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.212383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10712c-d3fb-474f-a07c-6c42d825dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.212653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10712c-d3fb-474f-a07c-6c42d825dbf6 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/cce8fd8a8e2547979eb2df2ad0bc6218/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.228589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10712c-d3fb-474f-a07c-6c42d825dbf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=cce8fd8a8e2547979eb2df2ad0bc6218, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:12.230053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10712c-d3fb-474f-a07c-6c42d825dbf6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:12.293563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 413/832] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:26:12 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/cce8fd8a8e2547979eb2df2ad0bc6218/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:26:12.493260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acdda-eea8-4c81-841c-6178ac0dd2ce None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.493788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acdda-eea8-4c81-841c-6178ac0dd2ce None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.493788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acdda-eea8-4c81-841c-6178ac0dd2ce None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.495480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 420/833] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:12.502287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582118-e34e-4881-8d0b-3a6efe199e54 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.502572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582118-e34e-4881-8d0b-3a6efe199e54 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.502829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582118-e34e-4881-8d0b-3a6efe199e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.522382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-48582118-e34e-4881-8d0b-3a6efe199e54 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:12.523587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-48582118-e34e-4881-8d0b-3a6efe199e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:12.601668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 414/834] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:12.789396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65a2e8-91a8-42c9-a65c-e1710aa7e634 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.789745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65a2e8-91a8-42c9-a65c-e1710aa7e634 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.789945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65a2e8-91a8-42c9-a65c-e1710aa7e634 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.791645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 421/835] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:12.798152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.798448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.798718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.817689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:12.818875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:12.874914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65a2e8-91a8-42c9-a65c-e1710aa7e634 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:12.883417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:12.894085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 415/836] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:12.946287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:12.986285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65a2e8-91a8-42c9-a65c-e1710aa7e634 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.024293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.025347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.025835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.026325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.027109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.028694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:13.038227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:13.039252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:13.040177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.042748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 422/837] 10.222.0.64 () {56 vars in 1132 bytes} [Fri Sep 9 11:26:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:13.048868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.151637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772507d-3327-4405-868a-89c1ca3a2098 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.185005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.187020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.187632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.187906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.188172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.188798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:13.189093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.190490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.196006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 416/838] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:13.206327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.274274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:13.305614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcf197-44a3-4975-ad21-8d0634562a67 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.321424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5541-9b2a-48f4-b9e6-c3afe04a3ad8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.335575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:13.344603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.345413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.346096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.346096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.346876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.348231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-68112bf3-2e8f-4233-8e35-af8f8bdf9754 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:13.359140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:13.360410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:13.361496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.362850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 423/839] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:13.364464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636217e9-6e4b-4b66-947c-c9b9115f33a9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.365106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.365742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.366012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.366276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.366725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636217e9-6e4b-4b66-947c-c9b9115f33a9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.366981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636217e9-6e4b-4b66-947c-c9b9115f33a9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.368227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 424/840] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:13.368896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636217e9-6e4b-4b66-947c-c9b9115f33a9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.369798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:13.370100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.371437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f139132-6dd1-428d-9b17-c674d851a5ab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.380998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 417/841] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:13.380998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.380998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.380998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.407927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:13.410394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:13.494318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636217e9-6e4b-4b66-947c-c9b9115f33a9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.521120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 418/842] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:13.542092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.542759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.543040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.543309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.543938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:13.544296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.546413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.552105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 425/843] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:13.558020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.614456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:13.664234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa40fec-972d-4c3d-bbdd-86f6b80d0da5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.699262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.699865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.700137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.700403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.701588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:13.701884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.703234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.708303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 419/844] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:13.817021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.882884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:13.930275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364a77f-efc6-453b-ac7d-2b2633db2ae9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.967225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.968234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.968715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.969184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.980148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:13.988981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:13.990990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:13.991889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:13.994701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 426/845] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:14.001939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:14.110027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc2e0-03b1-49b0-8559-aef4dd5f06a6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:14.129143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:14.147673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:14.148280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.148564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.148827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.149521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:14.149821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:14.151175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:14.160198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 420/846] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:14.168599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:14.280520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20ba9-82d5-4792-b01a-8e767387ba3d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:14.300083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:14.320708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:14.321722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.322222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.322695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.335107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:14.336873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:14.353564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:14.354606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:14.355576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:14.355576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:14.355576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:14.358364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 427/847] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:14.366436 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:14.475832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5658148-72ac-452e-abfa-4b04342be2c8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:14.511784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:14.512768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.513792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.514329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.515184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:14.515687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:14.517275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c976326-f2d6-459d-9a75-f436bb2ba4c2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:14.530789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 421/848] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:14.540648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:14.670396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198d5f-9b36-4b78-9f83-5939d7b82104 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:14.732825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:14.733480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.733753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.734021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.743407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:14.744847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:14.756423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6372f6-cbfd-4728-94ca-435d11d0ecc9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:14.756962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:14.757934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:14.758922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 428/849] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:14.760093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6372f6-cbfd-4728-94ca-435d11d0ecc9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.760580 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6372f6-cbfd-4728-94ca-435d11d0ecc9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.762371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 422/850] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:14.766458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:14.767844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.768340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.768833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.787707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:14.789203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:14.794139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:14.821378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:14.869536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 423/851] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:14.870386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2c2d2-bbea-417b-9b59-bb9918fe723b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:14.906439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:14.907037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:14.907404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:14.907675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:14.908455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:14.908760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:14.910271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:14.929245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 429/852] 10.222.0.64 () {56 vars in 1135 bytes} [Fri Sep 9 11:26:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:14.935547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.047324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea32986-0ab5-4b45-93e3-5898f073f2f8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.083739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.084685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.085230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.085684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.127075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:15.160416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:15.161899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:15.182834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.274234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 424/853] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:15.275609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.281881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:15.304113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf35fe7-d8ec-4370-8d41-b00771e892bf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.340329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.340957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.341333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.341595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.354643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:15.355368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:15.362433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:15.370287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:15.371183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 430/854] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:15.374701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.411285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340cd3c-d568-4e42-a994-b9b92d272726 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.458673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.459635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.460744 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.461240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.477368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:15.486251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:15.505033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88adf-84af-47ec-bf4b-bec7514afdc3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:15.512578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:15.513954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:15.514872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:15.514872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:15.514872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:15.520318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 425/855] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:15.522209 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.559600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.561932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.562229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.562506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.563175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:15.563474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:15.564848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:15.578499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 431/856] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:15.580623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.594775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:15.646162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c575560-cff8-44c1-be3b-a8dcb22f80ce None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.666861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:15.680827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.681830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.681830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.682118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.682687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:15.682981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:15.684322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249f90-df1d-4ee5-9aa2-48ed55aa8c24 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:15.695863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519ee22-f4e3-4219-9e02-ac547f9d0fef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.701373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 426/857] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:15.701373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f589-4ee2-4da7-b5fb-16485efa7c2c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.701373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f589-4ee2-4da7-b5fb-16485efa7c2c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.701373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f589-4ee2-4da7-b5fb-16485efa7c2c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.704224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 427/858] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:15.706155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f589-4ee2-4da7-b5fb-16485efa7c2c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.736480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.737106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.737447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.737720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.749915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:15.751631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2cf79f53-1026-4356-a84d-7696adcb257e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:15.766836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:15.767807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:15.768710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:15.768710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:15.768710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:15.768710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 432/859] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:15.769520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.769804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.770081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.787940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:15.789126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:15.822108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f589-4ee2-4da7-b5fb-16485efa7c2c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:15.847072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:15.865244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:15.865434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 433/860] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:15.865530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:15.865530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:15.867787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.867885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:15.875861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:15.877331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:15.891767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:15.892743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:15.893669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:15.897430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 428/861] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:15.900434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:15.949880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:16.015044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b09313-2655-4335-bd5b-1af654584b26 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.016589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd90a4-8de6-400b-9914-928e893375f8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.054104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.054712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.054992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.055262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.055847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.055970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:16.056188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.056455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.056731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.056997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.057597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941483f-ed41-4c8b-8409-4e23484a667c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.057694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:16.057997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.059574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2f83b-b9e9-42e4-a13c-bb935627084b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.074207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 434/862] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:16.074207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45a7a-4965-4441-b5ab-4bc4183bb319 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.074207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45a7a-4965-4441-b5ab-4bc4183bb319 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.074207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c45a7a-4965-4441-b5ab-4bc4183bb319 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.074207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 435/863] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:16.075210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45a7a-4965-4441-b5ab-4bc4183bb319 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.080428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 429/864] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:16.082047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.082535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.082970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.103645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:16.105133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:16.130438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:16.178463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 430/865] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:16.179313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.189995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c45a7a-4965-4441-b5ab-4bc4183bb319 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.214952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:16.240104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.240884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.241163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.241775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.253322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.255294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:16.270380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:16.271374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:16.272361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:16.276541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 436/866] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:26:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:16.277368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.292230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d409ed-8b05-474a-8d14-65c554a97dfd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.327718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.328602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.329078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.329531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.330440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=90ff1707eb264477b0a120e10c5d7a63) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:16.330893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.332469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.338632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 431/867] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:16 2022] GET /identity/v3/role_assignments?user.id=90ff1707eb264477b0a120e10c5d7a63&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:16.339578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.409695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46104ce-040c-44c9-bd74-149c49fc4020 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.421929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:16.448970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.449628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.449906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.450195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.450890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.452284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.465630 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:16.473489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cb406-aead-4eb3-97e8-f8905595d07c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.509730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.510344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.510624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.510897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.511691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:16.512002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.514215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.525757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 437/868] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:16 2022] POST /identity/v3/services => generated 269 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:16.528998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.538076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 432/869] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Sep 9 11:26:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:16.546583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.677010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5fe26-df6b-4da2-84af-861e27b32e96 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.714378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838b856-4975-4a96-af2e-892954ca2d91 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:16.719357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.719966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.720243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.720509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.721247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.722638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.752966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:16.753934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:16.754204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:16.754476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:16.777072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:16.822533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:16.823974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:16.835713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 438/870] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:16 2022] POST /identity/v3/services => generated 251 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:16.952558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 433/871] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:16 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:26:16.958213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:16.993892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:17.079887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf2b0-41b9-496a-a983-169613e0e294 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:17.115411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:17.116038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:17.116316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:17.116584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:17.128671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:17.130159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:17.145594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:17.146590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:17.147499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:17.147499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:17.147499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:17.147499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 439/872] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:17.154531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:17.212761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:17.265454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d90f-d096-4555-a386-c98854e54e5e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:17.303624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:17.304584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:17.305061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:17.305556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:17.306445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:17.306942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:17.308553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:17.322304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 434/873] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:17.328547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:17.412774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:17.438832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750205ce-da20-4a38-95e2-b3dc2a995e62 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:17.474295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:17.474847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:17.475120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:17.475388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:17.483953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:17.485464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:17.499213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:17.500452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:17.501474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 440/874] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:17.508110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:17.620720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45d356-b587-4f62-96a5-0716b603833a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:17.642219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:17.664785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:17.665753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:17.666256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:17.666746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:17.667638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:17.668137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:17.670377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8eb5e-1609-4ba9-903c-1dcd48a49f18 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:17.683082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 435/875] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:17.690163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:17.801345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58488d-e77b-49ca-ac48-9927344aa4a1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:17.839882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:17.841011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:17.841349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:17.841649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:17.842408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=cce8fd8a8e2547979eb2df2ad0bc6218) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:17.842717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:17.844156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784272c1-55e2-4f9e-8ce3-a9fb53ec1e49 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:17.846047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:17.851535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 441/876] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:17 2022] GET /identity/v3/role_assignments?user.id=cce8fd8a8e2547979eb2df2ad0bc6218&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:18.695829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c61c-b42b-4b76-9669-de7e18b5374a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:18.696681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c61c-b42b-4b76-9669-de7e18b5374a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:18.697088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c61c-b42b-4b76-9669-de7e18b5374a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:18.698620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 436/877] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:18.704715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:18.705193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:18.705295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:18.724478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:18.725702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:18.784884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75326833-1687-4386-bfb1-c3a259338193 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:18.785229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75326833-1687-4386-bfb1-c3a259338193 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:18.785495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75326833-1687-4386-bfb1-c3a259338193 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:18.788339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 437/878] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:18.792457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:18.792740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:18.793013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:18.797956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 442/879] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:18.814296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:18.815503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:18.902516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 438/880] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:19.069603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.158552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.178446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffb8a9-ea65-4d6d-b365-b652e706e557 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.207616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:19.218048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.222964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.222964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.222964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.222964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.222964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e914b56e-f930-4e18-9cd4-5aaa222c5972 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:19.230941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:19.232901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:19.233790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 443/881] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:19.234609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6d590-6946-430a-90bc-6d9a82d6ba37 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.234609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6d590-6946-430a-90bc-6d9a82d6ba37 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.234609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6d590-6946-430a-90bc-6d9a82d6ba37 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.235846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 444/882] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:19.238191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6d590-6946-430a-90bc-6d9a82d6ba37 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.272964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52883233-c4d1-4046-9229-fdf2cef63cde None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.274539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:19.310891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.311931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.313146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.313648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.314389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.315896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-021b6361-f131-48a2-a5e3-cb94faec483d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:19.326201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:19.327359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:19.328486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:19.335230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 439/883] 10.222.0.64 () {56 vars in 1132 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:19.335230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.335230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.335230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.344184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6d590-6946-430a-90bc-6d9a82d6ba37 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.353706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:19.354902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:19.380116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.381122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.381614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.382058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.382677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:19.382979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.384599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.394396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 445/884] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:19.395192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.427074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 440/885] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:19.427660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.455765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:19.504721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc418f4-361d-411f-bd45-904b7191024c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.542711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.543342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.543708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.544187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:19.545195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.546023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:19.546474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.548057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.550339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c66f9-3067-45e1-a74b-efc2d7a939c0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.553846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 446/886] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:19.561521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.591866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.592991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.593557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.593963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.594870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:19.595314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.596816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.603129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 441/887] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:19.694843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcc71-3915-49b9-b25f-25b404838ddb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.708248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.719931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:19.738260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.739271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.740333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.740333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.740932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:19.741521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.743346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.750285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 447/888] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:19.761304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.838292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cad8-1acb-45db-908a-48c5d668cdfe None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.884230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.884874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.885150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.887686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8cb62-fb41-440d-8b3d-48e8b75a3b80 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:19.888283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.889097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.891420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:19.901565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:19.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:19.904685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:19.906320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 442/889] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:19.913336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:19.934675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:19.935278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:19.935546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:19.935836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:19.936875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] RBAC: Adding query filter params (interface=public, service_id=b9985edde5d3416eb8d54ce395878bb7, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:19.937175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:19.938570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:19.945837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:19.949416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 448/890] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/endpoints?service_id=b9985edde5d3416eb8d54ce395878bb7&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:19.954618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:20.011156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:20.043291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8ff1-ae58-43eb-ae9d-ca0c22079ccb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.067565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01ec07-be61-4d64-9008-1d4f40d67ef8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.083786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.084874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.085419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.086165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.087000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:20.087507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:20.089527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:20.096524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 443/891] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:20.101691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:20.106425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3480-cb4c-4666-b584-f4989ac11e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.107129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3480-cb4c-4666-b584-f4989ac11e2c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.107402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3480-cb4c-4666-b584-f4989ac11e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.107667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3480-cb4c-4666-b584-f4989ac11e2c None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.108263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e3480-cb4c-4666-b584-f4989ac11e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:20.109649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e3480-cb4c-4666-b584-f4989ac11e2c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:20.116095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 449/892] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:19 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:26:20.207299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:20.220761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589358-c3f0-446b-9fc5-66375f61cb04 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.256219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ddbb5-ef08-4e41-b6e5-2be4fb577297 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.256464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ddbb5-ef08-4e41-b6e5-2be4fb577297 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.256744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ddbb5-ef08-4e41-b6e5-2be4fb577297 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.258391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 450/893] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:20.260314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.261128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.261581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.262056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.262834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:20.263289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:20.264182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.264469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.264791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.265474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:20.273795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 444/894] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:20.279572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:20.284605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:20.285851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:20.370439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 451/895] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:20.406708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a2f47-cec1-4443-ba7a-7e45d7a1b814 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.443369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.444335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.444849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.445356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.446254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] RBAC: Adding query filter params (interface=public, service_id=3a84530164784bd3ae25c40613f3d47a, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:20.446779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:20.448377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:20.455026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 445/896] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:20 2022] GET /identity/v3/endpoints?service_id=3a84530164784bd3ae25c40613f3d47a&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:20.465307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:20.505551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:20.563343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef79fef-645a-45d2-b694-437b7c9f81d2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.600137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.600736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.601009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.601301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.601955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:20.603318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:20.610140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 452/897] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:20 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:26:20.670077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:20.690946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:20.784527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc402b-56fb-41e4-b780-6c5ceaf16575 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.822333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.823216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.823645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.824062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.834919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:20.841108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:20.842332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:20.843424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:20.845809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 446/898] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Sep 9 11:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:20.852945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:20.955027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ae2a-be72-47b5-89b0-4a721f8b05b9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:20.962781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:20.990425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:20.991020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:20.991292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:20.991554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:20.992203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:20.992497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:20.993936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:21.007948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 453/899] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:21.009377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:21.089260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:21.113997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e565e1-2e62-4d05-8ad6-bfaa1e53403c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:21.159077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:21.159698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.159970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.160232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.172268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:21.173729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:21.188370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:21.190617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:21.192782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:21.192782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:21.192782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:21.197232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 447/900] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:21.197437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:21.300266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a783c-a7f2-4d06-987b-01ec76440e67 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:21.338440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:21.339038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.339360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.339620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.340315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:21.340605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:21.341992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:21.359282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 454/901] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:21.360596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:21.469091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b96c-4e24-4a9c-a6bc-76d0f4d98917 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:21.497249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:21.506036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:21.506657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.506927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.507190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.515018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:21.519276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:21.528514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:21.530689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:21.532984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:21.534364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 448/902] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:26:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:21.541243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:21.568344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:21.662967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b6b28-0cdd-473a-a752-769e1d9bd18e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:21.698700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:21.699353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.699629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.699900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.700611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:21.700955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:21.702407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4165f85-f06e-41d8-bada-c369a9bfee94 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:21.720431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 455/903] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Sep 9 11:26:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:21.726026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:21.833831 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83409b8-65eb-4eb6-9d15-46ccf56b85f5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:21.873995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:21.874850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.875123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.875389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.935397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:21.948491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:21.950480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:21.962588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc70a6-5145-4340-81ce-0bc00c403bb1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.962588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc70a6-5145-4340-81ce-0bc00c403bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.962588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc70a6-5145-4340-81ce-0bc00c403bb1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.962588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 456/904] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:21.972630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:21.972630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:21.972630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:21.992299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:21.994311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:22.069323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 449/905] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:21 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:22.071664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:22.087504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 457/906] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:22.165768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:22.178979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c38cc-6ad8-4709-888c-c87e344ef1c1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:22.215446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:22.216073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.216350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.216619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.227222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:22.228722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:22.244441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:22.245431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:22.247243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:22.247243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:22.247243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:22.247243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 450/907] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:22.253687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:22.273774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:22.359646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b512b-5dfc-4edc-910b-e6f5d0cf0265 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:22.365574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:22.406565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:22.407373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.407655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.407924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.408586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:22.408887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:22.410722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:22.431816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 458/908] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:22.436669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:22.508550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257dba-9dcd-4321-9fce-e6034fae0e80 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:22.520573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:22.543591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8351b8-ff89-4ccf-8df8-d5081550cdf3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:22.546378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b6522-d3bd-454c-aef5-1662d237a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:22.546987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b6522-d3bd-454c-aef5-1662d237a642 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.547266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b6522-d3bd-454c-aef5-1662d237a642 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.547539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b6522-d3bd-454c-aef5-1662d237a642 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.548201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b6522-d3bd-454c-aef5-1662d237a642 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:22.549605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b6522-d3bd-454c-aef5-1662d237a642 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:22.579396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:22.580005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.580328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.580593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.587007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:22.588425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-70b68b1c-2b86-4c05-af6c-a8788121cf59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:22.599841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:22.600944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:22.602043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:22.602692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 459/909] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:22.604029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea40f-0940-413e-9fd4-38f4ee3ab3d7 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.604321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea40f-0940-413e-9fd4-38f4ee3ab3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.604591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea40f-0940-413e-9fd4-38f4ee3ab3d7 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.606085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 460/910] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:22.606776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea40f-0940-413e-9fd4-38f4ee3ab3d7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:22.618676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:22.633238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 451/911] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:22 2022] POST /identity/v3/services => generated 241 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:26:22.633238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.633238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.633238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.659422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:22.661066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:22.743075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea40f-0940-413e-9fd4-38f4ee3ab3d7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:22.753780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 452/912] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:22.779086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:22.784601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:22.785302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.785657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.785930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.786655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:22.793491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:22.793491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ed2e1-0185-4c16-9f3c-b92ceddc2afc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:22.805200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 461/913] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:22.812699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:22.906633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83c28-ac88-4dcf-8f21-e24ebd48cb34 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.906991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83c28-ac88-4dcf-8f21-e24ebd48cb34 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.907171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83c28-ac88-4dcf-8f21-e24ebd48cb34 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.908736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 462/914] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:22.913751 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346926-99c5-43f6-abcf-616f60458fec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.914030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346926-99c5-43f6-abcf-616f60458fec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.914293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346926-99c5-43f6-abcf-616f60458fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.918322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd41cd-4b1b-4699-aae9-c89f21706ed0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:22.932424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-21346926-99c5-43f6-abcf-616f60458fec None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:22.934183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21346926-99c5-43f6-abcf-616f60458fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:22.947219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:22.960503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:22.961898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:22.962614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:22.963058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:22.964220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] RBAC: Adding query filter params (role.id=41418e9806ef437fb689c35400b95122, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=cce8fd8a8e2547979eb2df2ad0bc6218) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:22.965678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:22.967896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:22.981848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 453/915] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:22 2022] GET /identity/v3/role_assignments?user.id=cce8fd8a8e2547979eb2df2ad0bc6218&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=41418e9806ef437fb689c35400b95122 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:23.012330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 463/916] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:23.032518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.143343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d11c5b-8dc9-409d-bafe-14b39064f129 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.184811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.185849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.186126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.186394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.186982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.188336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:23.197700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:23.198666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:23.199649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 454/917] 10.222.0.64 () {56 vars in 1132 bytes} [Fri Sep 9 11:26:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:23.210316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21346926-99c5-43f6-abcf-616f60458fec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.298020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.319135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21346926-99c5-43f6-abcf-616f60458fec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.345780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:23.358768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.360786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.360786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.360786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.361466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:23.362055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.363616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.368159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:23.370301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 464/918] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:23.377125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.423654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd6c7-a5a3-45b0-ac48-00e3b74b4be2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.459353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.460336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.460810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.461301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.462105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.463675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:23.473301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:23.474368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:26:23.475237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:23.481730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 455/919] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:23.485569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.492802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7216c-4ab7-4ddb-a83d-9ca158fd5522 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.535309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.536588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.537610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.538098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.539256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:23.539758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.542257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.556626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 465/920] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:23.557646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.612697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:23.616769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c988f-4453-4f41-8b4c-10075820c54c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.639330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:23.662100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.663287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.663869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.664343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.665204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:23.665736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.667362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.667558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675b1a-c640-40ba-b195-1bf32cbec75c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.678753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 456/921] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:23.679567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.709611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.710194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.710467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.710732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.711390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.712749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.793796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36244f-bae2-4967-b96e-99386e9979bd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:23.805266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 466/922] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:26:23.849721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:23.850369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:23.850645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:23.850915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:23.851586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:23.851883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:23.853266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73fed-f9b6-4434-b16c-d17634eaeb58 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:23.860398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 457/923] 10.222.0.64 () {56 vars in 1114 bytes} [Fri Sep 9 11:26:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:23.865700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:23.994611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aea3c-94af-4671-9e8f-93d640746539 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:24.003471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:24.030978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bf197-be6f-4f3c-8993-a0e2e8b9b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:24.031622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bf197-be6f-4f3c-8993-a0e2e8b9b082 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:24.031829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bf197-be6f-4f3c-8993-a0e2e8b9b082 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:24.032095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bf197-be6f-4f3c-8993-a0e2e8b9b082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:24.032744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bf197-be6f-4f3c-8993-a0e2e8b9b082 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:24.034156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bf197-be6f-4f3c-8993-a0e2e8b9b082 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:24.143022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 467/924] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:26:24.936244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e115-7d95-460e-b881-4be01e4c95e7 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:24.936740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e115-7d95-460e-b881-4be01e4c95e7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:24.936740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e115-7d95-460e-b881-4be01e4c95e7 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:24.938287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 458/925] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:24.944175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b5198-d999-43f9-b662-676dfef1f05e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:24.944458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b5198-d999-43f9-b662-676dfef1f05e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:24.944738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b5198-d999-43f9-b662-676dfef1f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:24.964732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-450b5198-d999-43f9-b662-676dfef1f05e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:24.966247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-450b5198-d999-43f9-b662-676dfef1f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:25.057993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 468/926] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:25.285680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7e254-13de-41de-a598-9ce05d90c02b None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:25.286135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7e254-13de-41de-a598-9ce05d90c02b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:25.286289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7e254-13de-41de-a598-9ce05d90c02b None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:25.287783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 459/927] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:25.293930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:25.294214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:25.294490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:25.317546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:25.318740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:25.373353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7e254-13de-41de-a598-9ce05d90c02b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:25.394388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 469/928] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:25.432678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:25.501426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7e254-13de-41de-a598-9ce05d90c02b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:25.540321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:25.540873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:25.541149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:25.541448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:25.542031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:25.544307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:25.554346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:25.555373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:25.556236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 460/929] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:25.562471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:25.589497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:25.688100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ee43-d43f-49ed-8f6d-83164de3d60d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:25.713364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:25.731602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:25.732281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:25.732564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:25.732835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:25.733841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:25.734144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:25.735611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:25.742360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 470/930] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:25.750916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:25.845711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b688-566f-4b76-987d-cd567c2a3f55 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:25.850758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:25.858866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:25.882361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322fd12-249e-4685-b370-0a0667088e9d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:25.888891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:25.890172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:25.890671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:25.891148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:25.927925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:25.932951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:25.934174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:25.935030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:25.935679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 461/931] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Sep 9 11:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:25.942450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:25.960129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:25.960741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:25.961020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:25.961320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:25.961955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:25.962257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:25.969241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:25.986166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 471/932] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:25.990416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.182152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab791c63-3d50-4711-9a5f-318e81cd880c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.210613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f75a6-0ee7-4220-98a4-a774a86afba5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.252491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.254065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.254528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.256243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.257136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:26.258893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.260444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29030aad-2448-4dcc-88ca-c6cf7c1738ba None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.276834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.279847 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.280126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.280395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.281121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] RBAC: Adding query filter params (interface=public, service_id=b1c568ce873d4dd2b4e2b533885435d6, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:26.281451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.282814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344662b-299f-4e93-b58e-c4d9fc2d3769 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.283708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 462/933] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:26:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:26.285001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31d56-a9d1-4b9d-9ce5-56685866a50c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.285303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31d56-a9d1-4b9d-9ce5-56685866a50c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.285574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31d56-a9d1-4b9d-9ce5-56685866a50c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.286932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 463/934] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:26.287482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31d56-a9d1-4b9d-9ce5-56685866a50c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.302283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 472/935] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:25 2022] GET /identity/v3/endpoints?service_id=b1c568ce873d4dd2b4e2b533885435d6&interface=public®ion_id=RegionOne => generated 194 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:26.302283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.302283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.302283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.324664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:26.325897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:26.330248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:26.339192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:26.413925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 473/936] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:26.414794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.451677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31d56-a9d1-4b9d-9ce5-56685866a50c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.493511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.494501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.495045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.495739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.509078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.510549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.525059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668970c-7335-454f-82a6-bdbe1f2e1da9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b645b137-e4e4-45c0-acf8-57565fdfef93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:26.525374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:26.526347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:26.527672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:26.527672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:26.527672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:26.527672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 464/937] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:26.528420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef376-95ae-4089-9cfb-55e34cc196ba None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.528420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef376-95ae-4089-9cfb-55e34cc196ba None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.528688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef376-95ae-4089-9cfb-55e34cc196ba None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.530002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 465/938] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:26.534120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef376-95ae-4089-9cfb-55e34cc196ba None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.564737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065044-c93c-4d32-8e39-67350036d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.565368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065044-c93c-4d32-8e39-67350036d90a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.565648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065044-c93c-4d32-8e39-67350036d90a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.565916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065044-c93c-4d32-8e39-67350036d90a None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.566515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a065044-c93c-4d32-8e39-67350036d90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.567929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a065044-c93c-4d32-8e39-67350036d90a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.574716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 474/939] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:26:26.575861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.576141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.576410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.584047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:26.602656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:26.605054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:26.642977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:26.671327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef376-95ae-4089-9cfb-55e34cc196ba None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.712867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.713398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 475/940] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:26.714724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.714898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.715315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.715767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.716578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:26.717027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.719850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.741556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 466/941] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:26.742992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.845017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534fe42-2a6e-4fe2-89fe-61474b515f7c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.864635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1ff4-ad19-4140-b30b-cd1ab057d19d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:26.890721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.892289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.892737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.894169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.895517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.898541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.902218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:26.905530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:26.906233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:26.906576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:26.906907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:26.912103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:26.918194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:26.919034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 476/942] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:26.919830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:26.919830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:26.921963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:26.922582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:26.932948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:26.934532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:26.935813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:26.941822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 467/943] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:26.943536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.040293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031be6d-fbb6-49d3-9624-9f4ea825097d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.063644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07044dad-dcf7-48e2-9f4a-afd6b539ed18 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.076082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.076684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.076962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.077247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.077891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:27.078186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.079538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.085028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 477/944] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:27.085960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.099533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.100223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.100406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.100714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.101449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:27.101749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.103157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.124031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 468/945] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Sep 9 11:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:27.125313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.163246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:27.186166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:27.206534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16e445-1720-4eac-a3fb-bb24df5ed1ca None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.233121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed056-749d-42b7-a258-4abe5648e031 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.241610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.242201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.242475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.242741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.243367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.244792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.248195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING keystone.server.flask.common [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 11:26:27.274255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.274853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.275129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.275398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.276021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:27.278182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.278182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.282550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 469/946] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:27.283314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.308122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.sql.core [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:26:27.308122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:26:27.308122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [parameters: {'id': '1dc383b800984811ad48fa551ce0a74f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:26:27.308122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81596) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dc383b800984811ad48fa551ce0a74f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dc383b800984811ad48fa551ce0a74f. Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:26:27.333791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 11:26:27.334702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application yield resource Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise self.value Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application session.commit() Sep 09 11:26:27.335661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:26:27.336601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:26:27.337554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:26:27.338388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [parameters: {'id': '1dc383b800984811ad48fa551ce0a74f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.340906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:27.342957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dc383b800984811ad48fa551ce0a74f. Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 478/947] 10.222.0.64 () {60 vars in 1140 bytes} [Fri Sep 9 11:26:27 2022] POST /identity/v3/projects => generated 262 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:27.345320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.429532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c17f-d489-4157-a035-1e8b3e2bb61b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.456193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:27.470090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.471114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.471588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.472075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.483905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.485884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.496640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7586-a994-4a13-88a7-d80ecee3b7de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:27.503932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:27.504983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:27.505967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:27.505967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:27.505967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:27.515883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 470/948] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:27.520516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:27.521558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.545554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.547052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.547777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.548221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.559707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.562646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:27.578057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:27.578973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:27.579878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:27.583100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 479/949] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:27.589596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.645285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60700e04-9de8-47c5-ae4a-33a470474283 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.682422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.683688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.684169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.684586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.685398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:27.685998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.687509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.707146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 471/950] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:27.708319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.719644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f104-a867-4dc3-bbdb-4a6391e3b95c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.746406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:27.766136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.766734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.767013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.767339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.767995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:27.768292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.769940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.795002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 480/951] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:27.830649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372a31-1285-4d4d-ad3a-58d2aab6f3cb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:27.871337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:27.872267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.872689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.873096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.881598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:27.883302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:27.897316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:27.899679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:27.900883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:27.902124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 472/952] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:27.908160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:27.955324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:28.020554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe61b9-0428-4a84-ab1a-e87dafe460cb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:28.056802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:28.058047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.058505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.058973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.059825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:28.060316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:28.061949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12359e-9787-47bd-a3a8-949dcfffebd9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:28.076147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 481/953] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:28.081664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:28.182921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:28.189316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56ef25-93fa-4dfb-8697-4e643f7542f7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:28.225671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f001f-ed20-4cfe-a7ba-5544f7410d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:28.226325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f001f-ed20-4cfe-a7ba-5544f7410d75 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.226600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f001f-ed20-4cfe-a7ba-5544f7410d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.226866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f001f-ed20-4cfe-a7ba-5544f7410d75 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/cce8fd8a8e2547979eb2df2ad0bc6218/roles/41418e9806ef437fb689c35400b95122` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.229010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f001f-ed20-4cfe-a7ba-5544f7410d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=cce8fd8a8e2547979eb2df2ad0bc6218, role_id=41418e9806ef437fb689c35400b95122)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:28.230582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f001f-ed20-4cfe-a7ba-5544f7410d75 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:28.332276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 473/954] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:26:28 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/cce8fd8a8e2547979eb2df2ad0bc6218/roles/41418e9806ef437fb689c35400b95122 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:26:28.841721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa0270-311e-48dc-bf0b-23c81d1fc109 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.842262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa0270-311e-48dc-bf0b-23c81d1fc109 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.842262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa0270-311e-48dc-bf0b-23c81d1fc109 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.843845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 482/955] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:28.849410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.849700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.849970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.869558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:28.870784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:28.938636 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 474/956] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:29.210132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa0270-311e-48dc-bf0b-23c81d1fc109 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:29.312582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:29.320943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa0270-311e-48dc-bf0b-23c81d1fc109 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:29.355398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:29.356007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:29.356278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:29.356658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:29.357252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:29.358614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:29.367157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:29.368225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:29.369105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 483/957] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:29.375057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:29.460582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:29.478088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5dcb-399d-40cb-a19a-b5b4f4790031 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:29.520468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:29.521081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:29.521390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:29.521658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:29.522289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:29.522588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:29.524048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90c836-f8f7-4ea0-9a13-c4c2ba5d84fa None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:29.530802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 475/958] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:29.536075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:29.619256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdbb00-5023-4275-9fc6-3e66e4d40b7d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:29.620121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdbb00-5023-4275-9fc6-3e66e4d40b7d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:29.620387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdbb00-5023-4275-9fc6-3e66e4d40b7d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:29.622025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 476/959] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:29.628003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:29.628568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:29.629043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:29.653844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:29.655939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:29.659540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea455e8-20b7-463f-be34-e81d5084a8d1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:29.696710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:29.697858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:29.698341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:29.698797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:29.699800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:29.700365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:29.701935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:29.712537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 484/960] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:29.714228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:29.745004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 477/961] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:29.751947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:29.830706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca0a2-690b-4073-a982-664227d0ff67 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:29.867788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e74ba-dfac-4f86-986c-921366c3d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:29.869296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e74ba-dfac-4f86-986c-921366c3d7c3 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:29.870304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e74ba-dfac-4f86-986c-921366c3d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:29.870774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e74ba-dfac-4f86-986c-921366c3d7c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:29.871643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e74ba-dfac-4f86-986c-921366c3d7c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:29.873571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e74ba-dfac-4f86-986c-921366c3d7c3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:29.977073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 485/962] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:30.027674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:30.116666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:30.124492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4a69-a6d3-4bdc-bc38-386a5dbc9d36 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.124774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4a69-a6d3-4bdc-bc38-386a5dbc9d36 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.125049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4a69-a6d3-4bdc-bc38-386a5dbc9d36 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.127950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 486/963] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:30.132442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.132719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.132990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.144388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780374a2-fc3f-4939-8d6d-09e66fded350 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:30.154334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:30.156259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:30.193286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fd695-753d-47f1-90b0-1e3266070aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:30.193898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fd695-753d-47f1-90b0-1e3266070aff None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.194171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fd695-753d-47f1-90b0-1e3266070aff None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.194434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fd695-753d-47f1-90b0-1e3266070aff None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.195723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fd695-753d-47f1-90b0-1e3266070aff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:30.197072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fd695-753d-47f1-90b0-1e3266070aff None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:30.240189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 487/964] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:30.272025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 478/965] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:30 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:30.526742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:30.541774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:30.654475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4411-2ada-4b84-8d2a-ec1ede46e47c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:30.698145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:30.698749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.699022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.699287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.699931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:30.701387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:30.706291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2cdcf-779a-41ff-99a4-c21db0e1bb9f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.706776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2cdcf-779a-41ff-99a4-c21db0e1bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.706855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2cdcf-779a-41ff-99a4-c21db0e1bb9f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.708419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 479/966] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:30.714012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.714293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.714563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.733285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:30.734578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:30.746937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.sql.core [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:26:30.746937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:26:30.746937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [parameters: {'user_id': 'c159fa8a476d499d98a5cb1ace32cb03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:26:30.746937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81596) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Sep 09 11:26:30.755427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:26:30.756504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application yield resource Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise self.value Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application session.commit() Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:26:30.757582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:26:30.759155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:26:30.760488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:26:30.761900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c159fa8a476d499d98a5cb1ace32cb03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:30.763551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 11:26:30.764913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:30.765942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 488/967] 10.222.0.64 () {60 vars in 1131 bytes} [Fri Sep 9 11:26:30 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:30.767003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:30.826012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 480/968] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:30.861470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:30.896639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98e5a-ee3c-4140-bd3d-9a63adf89855 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:30.939761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:30.940807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:30.941327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:30.941816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:30.951210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:30.955259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:30.967967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:30.969026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:30.970515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 489/969] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:30.979633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:31.047609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:31.086422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a18a5-ef0a-4b84-abc7-9f1664b12765 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:31.116812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:31.132451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:31.133372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:31.133657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:31.133929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:31.134629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:31.134964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:31.136381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:31.179042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 481/970] 10.222.0.64 () {56 vars in 1101 bytes} [Fri Sep 9 11:26:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:31.237946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86a8c-22f3-43de-b9be-ad54253de179 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:31.274646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:31.281653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:31.282308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:31.282645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:31.285853 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:31.298024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:31.306197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:31.307743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:31.308593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:31.309313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 490/971] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Sep 9 11:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:31.317120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:31.442405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade26f93-21c7-4485-a8cf-62b4cd14fde2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:31.466255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:31.477633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:31.478245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:31.478646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:31.478928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:31.479750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:31.480058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:31.481530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:31.490694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 482/972] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:31.497542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:31.600479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c07a-d703-4a5f-b2ec-ee4fe3baa83c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:31.636593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:31.637380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:31.637660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:31.637929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:31.649053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:31.651111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:31.665318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:31.666315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:31.667246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:31.667246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:31.667246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:31.667246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 491/973] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:31.673669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:31.784602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a0647-49a8-49c6-a4b4-30ebca04ad9a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:31.817534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:31.818133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:31.818410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:31.818677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:31.819303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:31.819600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:31.820946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:31.837701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 483/974] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:31.840043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:31.885692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:31.942394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa563c-e31e-422a-bc82-669b568b17c7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:31.976396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:31.977016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:31.977318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:31.977585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:31.985456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:31.986879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:31.999427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:32.000514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:32.001514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 492/975] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:26:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:32.008035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.058851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:32.115416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bd315-bf30-4caa-b4c3-79afa5d7a214 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:32.150775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:32.151749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.152030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.152297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.153018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:32.153349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:32.154778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d7e1-e6e5-4df3-a84e-90ba56e180d9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:32.177586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 484/976] 10.222.0.64 () {56 vars in 1149 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:32.178531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.286379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217c10-fa23-4587-8bc1-744e9990692f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:32.287903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:32.322201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797dd62-70a3-4d34-b9aa-684b3edf1132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:32.323068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797dd62-70a3-4d34-b9aa-684b3edf1132 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.323357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797dd62-70a3-4d34-b9aa-684b3edf1132 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.323629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797dd62-70a3-4d34-b9aa-684b3edf1132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.345609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f120c-1608-4a39-af37-2d8e80c8b982 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.346074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f120c-1608-4a39-af37-2d8e80c8b982 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.346548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f120c-1608-4a39-af37-2d8e80c8b982 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.348959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 485/977] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:32.357228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.357640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.357909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.376857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:32.378077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:32.399558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797dd62-70a3-4d34-b9aa-684b3edf1132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:32.401411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797dd62-70a3-4d34-b9aa-684b3edf1132 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:32.453277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 486/978] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:32.512727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 493/979] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:32.518567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.551240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:32.582263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444cdb1-8428-4d10-87a0-4c206dc78960 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.582550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444cdb1-8428-4d10-87a0-4c206dc78960 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.582721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444cdb1-8428-4d10-87a0-4c206dc78960 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.586999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 494/980] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:32.591905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.592196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.592459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.598573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:32.612622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:32.614708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:32.633169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab23532-3aa8-4981-8b98-fb06ccf2637c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:32.668546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:32.669161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.669458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.669722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.679588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:32.681003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:32.692407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 495/981] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:32.699675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:32.700637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:32.706509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:32.706509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:32.706509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:32.706509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 487/982] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:32.706796 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.723443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.810255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58232d9-bf14-44ca-86e2-893592db16e3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:32.810755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:32.826273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4d76-5951-48aa-a7d8-aa53a2b60cd7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:32.842311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:32.847081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:32.847679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.847975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.848259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.848860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:32.849151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:32.850526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:32.862775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 496/983] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:32.865269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:32.865890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:32.866165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:32.870264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:32.870264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:32.870463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.870553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:32.879927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:32.880992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:32.881955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 488/984] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:32.887044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:32.976509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143aea7-9c39-4ef7-8bb2-e21cf45eaaab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:32.994315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb719-be33-4c7f-b946-061f6276948e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.011263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.011884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.012162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.012431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.019042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.020488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.027971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.028566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.028843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.029111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.029799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.030097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.031425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:33.031538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:33.032475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 497/985] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:33.033437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.041749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 489/986] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:33.042713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.058476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.085491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.133893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b115c-dc6d-4e43-944c-5b70689f16a4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.143142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd39a2-08b5-4691-b935-c02c98517b0e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.166727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.167340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.167612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.167876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.168446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.169839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.175979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.176593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.176864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.177124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.177822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.178116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:33.178291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:33.179472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:33.180377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:33.181152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.181303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 498/987] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:33.181303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.192061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 490/988] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.192859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.261300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.285651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695898-4e17-45e2-b291-3b05dff8b1f3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.291543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264befc-e750-4eda-b0e8-5bb74fddf38b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.301706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.319583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.320170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.320445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.320711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.321356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.321649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.323568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.326670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.327274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.327547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.327814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.328224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 499/989] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.328430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.328726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.328984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.330103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.337270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 491/990] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.337270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.429996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10de87-f042-46a8-bb5f-5b95f5f0b62e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.436185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6898b-d89d-4e14-bea8-a59edeaa2de9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.461842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.462938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.463296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.463568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.464273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] RBAC: Adding query filter params (role.id=41418e9806ef437fb689c35400b95122, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=cce8fd8a8e2547979eb2df2ad0bc6218) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.464568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.466026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.469568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.470157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.470429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.470696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.471385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] RBAC: Adding query filter params (interface=admin, service_id=b1c568ce873d4dd2b4e2b533885435d6, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.471621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 500/991] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/role_assignments?user.id=cce8fd8a8e2547979eb2df2ad0bc6218&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=41418e9806ef437fb689c35400b95122 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.471748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.472380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.473099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.476803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.485416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 492/992] 10.222.0.64 () {56 vars in 1249 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/endpoints?service_id=b1c568ce873d4dd2b4e2b533885435d6&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.486870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.529965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.588130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284c86-e521-4fc7-932d-cc5d19f4f761 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.604027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f63d4d-ad65-4ca4-b072-a6db289f401f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.630826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.631548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.631696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.631971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.632601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.632905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.634509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.640360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 501/993] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.646168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.652041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.652196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.652433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.653098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.653331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.654694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.662670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 493/994] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:26:33.766749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4ac8-f549-4e51-b893-19b6d0eb25d2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.777271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.805168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.805974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.806496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.806955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.807988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] RBAC: Adding query filter params (interface=public, service_id=bf8d6e4ae63a412f9e2405c6d4ae4f85, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:33.808301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.809741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e050-c9da-4d5f-9d04-c6544590b6c9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.820778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 502/995] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/endpoints?service_id=bf8d6e4ae63a412f9e2405c6d4ae4f85&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:33.823345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:33.891613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:33.930281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eb6f5-4119-43c7-b43f-c8551bbf0a4d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:33.965876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c8800-ce40-4d7c-970b-756ce1889b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:33.966525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c8800-ce40-4d7c-970b-756ce1889b58 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:33.966805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c8800-ce40-4d7c-970b-756ce1889b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:33.967080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c8800-ce40-4d7c-970b-756ce1889b58 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:33.967678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c8800-ce40-4d7c-970b-756ce1889b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:33.969045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c8800-ce40-4d7c-970b-756ce1889b58 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:33.981245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 494/996] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:33 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:26:35.682537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8985aa3-1da8-4014-867d-5b291356bb97 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:35.683072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8985aa3-1da8-4014-867d-5b291356bb97 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:35.683072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8985aa3-1da8-4014-867d-5b291356bb97 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:35.684446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 503/997] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:35.689818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065cad-296b-4188-bbc2-317a0d365e18 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:35.690248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065cad-296b-4188-bbc2-317a0d365e18 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:35.690446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065cad-296b-4188-bbc2-317a0d365e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:35.708788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-69065cad-296b-4188-bbc2-317a0d365e18 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:35.709993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-69065cad-296b-4188-bbc2-317a0d365e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:35.783646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 495/998] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:35.876513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4d0f5-1c14-41ea-bda5-f7b0245e2eb6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:35.876707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4d0f5-1c14-41ea-bda5-f7b0245e2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:35.876977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4d0f5-1c14-41ea-bda5-f7b0245e2eb6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:35.878502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 504/999] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:35.883669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fd4b-b566-4c77-92b5-dd0c577ab35e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:35.884006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fd4b-b566-4c77-92b5-dd0c577ab35e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:35.884301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fd4b-b566-4c77-92b5-dd0c577ab35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:35.902984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4722fd4b-b566-4c77-92b5-dd0c577ab35e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:35.904176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4722fd4b-b566-4c77-92b5-dd0c577ab35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:35.960270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:35.977287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 496/1000] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:36.053247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4d0f5-1c14-41ea-bda5-f7b0245e2eb6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.140731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9af668-9dbc-4cb0-8cbc-36ba75eaa793 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.141026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9af668-9dbc-4cb0-8cbc-36ba75eaa793 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.141193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9af668-9dbc-4cb0-8cbc-36ba75eaa793 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.142797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 497/1001] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:36.147504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.147780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.148045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.158666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4d0f5-1c14-41ea-bda5-f7b0245e2eb6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.166616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:36.167955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:36.192750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.193405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.193684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.193952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] PATH_INFO: `/v3/services/image` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.194521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.195881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:36.205142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:36.209417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:36.210284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 505/1002] 10.222.0.64 () {56 vars in 1105 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:36.212250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.249270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 498/1003] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:36.250004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.254332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.321972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc17428-502a-4163-b608-ab5f0108ce6c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.358165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.358985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.359438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.359851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.360637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] RBAC: Adding query filter params (name=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:36.361081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.361195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b552869-05d4-490a-96e8-32c72dd11ea3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.362732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.367978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 506/1004] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:36.373515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.384901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.404059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.404673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.404984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.405223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.405852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.407181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:36.417117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:36.418267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:36.419123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 499/1005] 10.222.0.64 () {56 vars in 1126 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:36.425938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.486586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.490273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0a078-e60e-4499-894e-c5531d1b435d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.530748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.531348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.531631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.531899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.532513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:36.532811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.534149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8dd98-9510-4fee-afb9-e5efa91c52bc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.534312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.538766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 507/1006] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:36.539690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.582585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.583195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.583470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.583735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.584367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:36.584661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.586065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.591571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 500/1007] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:36.597461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.655816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.657492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33cdc-afe9-4a5c-8b6a-891139f8f8b9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.693525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.694881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.695159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.695427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.696010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.697463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:36.706655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:36.707845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:36.708697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 508/1008] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:36.714880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.723281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8855-00f1-40a6-8a1f-60dee898e299 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.753275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.763000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.781680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.781680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.781680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.781680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:36.781680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.781680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.782123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 501/1009] 10.222.0.64 () {56 vars in 1122 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:36.782123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.830046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1edfd-8c3d-4b63-8734-bcad5065d22b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.865950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.866815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.867240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.867653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.869045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:36.869601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.871136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.876537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 509/1010] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:36.882017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:36.892706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52dcba-7686-401a-a5b0-ef74ed36f8d8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:36.904591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.929620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:36.931274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:36.931646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:36.932025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:36.932587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:36.933988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:36.976593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:36.985557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18300d-9f54-4cdc-84b2-6664d563841f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:37.018649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:37.019263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:37.019533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:37.019794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:37.020404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] RBAC: Adding query filter params (type=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:37.020746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:37.022132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a3aa-8d0b-4e2b-b478-0234e0d8ceca None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:37.026501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 502/1011] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:26:37.029065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 510/1012] 10.222.0.64 () {56 vars in 1112 bytes} [Fri Sep 9 11:26:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:37.041370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:37.158676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f85d5-d5c1-4a57-8d0e-8a5379cd2e17 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:37.195656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b85e5-cae0-472a-a9fd-b31841df4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:37.196373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b85e5-cae0-472a-a9fd-b31841df4c60 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:37.196855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b85e5-cae0-472a-a9fd-b31841df4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:37.197417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b85e5-cae0-472a-a9fd-b31841df4c60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:37.198449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b85e5-cae0-472a-a9fd-b31841df4c60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:37.199817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b85e5-cae0-472a-a9fd-b31841df4c60 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:37.276967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 503/1013] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:38.760744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90eb4-b222-4789-9ce5-3b8ccd7fcfd4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:38.761462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90eb4-b222-4789-9ce5-3b8ccd7fcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:38.761462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90eb4-b222-4789-9ce5-3b8ccd7fcfd4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:38.762785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 511/1014] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:38.767824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4947-b77a-4ea8-bfef-ec4699cd6a73 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:38.768204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4947-b77a-4ea8-bfef-ec4699cd6a73 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:38.768376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4947-b77a-4ea8-bfef-ec4699cd6a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:38.787517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-60ab4947-b77a-4ea8-bfef-ec4699cd6a73 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:38.788683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-60ab4947-b77a-4ea8-bfef-ec4699cd6a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:38.806274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:38.863186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 504/1015] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:38 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:39.136314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90eb4-b222-4789-9ce5-3b8ccd7fcfd4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:39.218362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d4e3-ef85-474b-8bb8-6faed48c2ef4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.218940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d4e3-ef85-474b-8bb8-6faed48c2ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.219222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d4e3-ef85-474b-8bb8-6faed48c2ef4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.220762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 505/1016] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:39.225937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42369f1-d024-4697-93bf-c1ab1db581c6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.226221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42369f1-d024-4697-93bf-c1ab1db581c6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.226495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42369f1-d024-4697-93bf-c1ab1db581c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.242137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90eb4-b222-4789-9ce5-3b8ccd7fcfd4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:39.246069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c42369f1-d024-4697-93bf-c1ab1db581c6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:39.247532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c42369f1-d024-4697-93bf-c1ab1db581c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:39.278271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b375ecd-138f-4025-9b79-667a2ce2b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:39.278861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b375ecd-138f-4025-9b79-667a2ce2b9fd None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.279136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b375ecd-138f-4025-9b79-667a2ce2b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.279398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b375ecd-138f-4025-9b79-667a2ce2b9fd None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.280031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b375ecd-138f-4025-9b79-667a2ce2b9fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:39.281413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b375ecd-138f-4025-9b79-667a2ce2b9fd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:39.319053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 506/1017] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:39.401344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 512/1018] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:39 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:39.540995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e94f-7a98-436e-a894-53f61df3b562 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.541380 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e94f-7a98-436e-a894-53f61df3b562 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.541589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e94f-7a98-436e-a894-53f61df3b562 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.543129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 507/1019] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:39.548618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.548905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.549167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.568546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:39.569769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:39.581471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:39.591730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e94f-7a98-436e-a894-53f61df3b562 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:39.654434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 513/1020] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:39.682766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:39.706503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e94f-7a98-436e-a894-53f61df3b562 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:39.740986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:39.741646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.741923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.742191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.744066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:39.745522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:39.747564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 508/1021] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:39.753201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:39.855369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1885b-63ce-41da-8f16-458fb4051aad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:39.890656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:39.891252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:39.891527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:39.891791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:39.892424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:39.893882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:39.910603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:39.927712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:40.015362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 514/1022] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:26:39 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:26:40.028819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87e3f-783d-4bf6-807b-ad07b8f72b8b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:40.067783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:40.068444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:40.068722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:40.068994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:40.081998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:40.087021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:40.088132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:40.089020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:40.094940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 509/1023] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Sep 9 11:26:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:40.095111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:40.210532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30198369-caa7-4e72-bdf3-8392d6093cf2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:40.248056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:40.248666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:40.248942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:40.249225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:40.249938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:40.250241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:40.251611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:40.260632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 515/1024] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:26:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:40.266391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:40.276514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:40.370675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe24a0-8456-47b2-9a1e-e08fce8f21a1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:40.404906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:40.405643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:40.405995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:40.406335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:40.416564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:40.418120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:40.433174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:40.434383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:40.435520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:40.435520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:40.435520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:40.436314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 510/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:40.444417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:40.505643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:40.552687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51cbc-5d2c-40fe-b9c1-7452aa32b306 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:40.587821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:40.588564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:40.588907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:40.589305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:40.590004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:40.590368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:40.591808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:40.608997 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 516/1026] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:40.610302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:40.678415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:40.721968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49236-720d-4ad5-a8dc-7133cdf41f94 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:40.756650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:40.757186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:40.757494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:40.757816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:40.766181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:40.767607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:40.778785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:40.779780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:40.780755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:40.784770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 511/1027] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:26:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:40.786005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:40.890443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc9bc-33e6-436a-ae7c-c6b3b3ca88d3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:40.907825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:40.926682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:40.927225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:40.927503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:40.927773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:40.933764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:40.933764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:40.933764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:40.953262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 517/1028] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:26:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:40.955728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.057832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da30d2-018c-4259-b1c3-0c9d03c35500 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:41.075033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:41.092367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:41.092970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.093270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.093546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.163411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:41.165135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:41.265923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 512/1029] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:40 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:41.271432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.373815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0684-45e7-4e3c-8ad3-77a07241bb4f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:41.408047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:41.408671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.408948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.409230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.420056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:41.421573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f9e8f1ad-ebac-4cea-ad6b-ad8cb1545de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:41.436380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:41.437372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:41.438336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:41.438336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:41.438336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:41.439266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 518/1030] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:41.443373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.463958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:41.551017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cd425-c201-4801-ae3c-0196188a7117 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:41.585279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:41.586160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.586537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.586937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.587673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:41.588073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:41.589548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:41.592940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdab2d-7bc5-4bce-a3fc-5f78573d4723 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.593234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdab2d-7bc5-4bce-a3fc-5f78573d4723 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.593502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdab2d-7bc5-4bce-a3fc-5f78573d4723 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.594836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 519/1031] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:41.599730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.600130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.600489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.609968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 513/1032] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:41.613964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.624742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:41.624742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:41.645728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:41.697956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 520/1033] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:41.703070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:41.724348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daca63-8503-4e49-8fa4-6e55117bd917 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:41.758328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:41.758949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.759223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.759486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.766025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:41.767452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:41.778997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:41.779898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:41.781172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 514/1034] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:41.785967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.887443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce8e8-23a0-4247-98ba-b9be8f924150 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:41.922710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:41.923340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:41.923591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:41.923820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:41.924493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:41.924788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:41.926238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:41.943356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 521/1035] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:41.945774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.969108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:41.988293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:42.053502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c5611-8f87-4a92-96bd-acb9ade21dd6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.074742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b87fe7-6a87-4112-9ae0-be366789fac9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.088820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.089448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.089724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.089998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.090863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] RBAC: Adding query filter params (role.id=41418e9806ef437fb689c35400b95122, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f354bf4e63d949ecbb86b123a7022293) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:42.091182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.092589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.098466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 515/1036] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:41 2022] GET /identity/v3/role_assignments?user.id=f354bf4e63d949ecbb86b123a7022293&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=41418e9806ef437fb689c35400b95122 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:42.112067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.112823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.113167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.113537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] PATH_INFO: `/v3/services/image` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.114231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.115738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-60d0035e-a516-434f-99be-1fb0935a9eaf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:42.126105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:42.127239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:42.128127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:42.129869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 522/1037] 10.222.0.64 () {56 vars in 1105 bytes} [Fri Sep 9 11:26:41 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:42.134232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:42.137311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:42.237330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbeaeb-72e3-4845-8c37-238f199eca66 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.237613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbeaeb-72e3-4845-8c37-238f199eca66 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.237883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbeaeb-72e3-4845-8c37-238f199eca66 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.239239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 523/1038] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:42.244985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9162-9cdd-42b2-aa5a-29111c7705ca None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.245457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.245742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.246011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.264778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:42.266016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:42.283039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.283644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.283916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.284181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.284797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] RBAC: Adding query filter params (name=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:42.285092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.286485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.292198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 516/1039] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:42.297897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:42.345605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 524/1040] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:42.369733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:42.404546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85bf6e-0b62-48b3-99d5-719ac0f55a4e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.441682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.442344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.442618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.442882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.445685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] RBAC: Adding query filter params (type=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:42.445685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.447785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.461168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 517/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:42.462728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:42.478730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:42.567902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aab4e7-307d-4758-b7dc-7f23e0c8973a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.603391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.603987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.604257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.604522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.605204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] RBAC: Adding query filter params (interface=public, service_id=caef8b7332044e9f8b13e9a3a1072c36, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:42.605525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.606877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.616529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 525/1042] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:26:42 2022] GET /identity/v3/endpoints?service_id=caef8b7332044e9f8b13e9a3a1072c36&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:42.619050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:42.623472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:42.701242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:42.725744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe93e-e30e-477d-b514-02822cf11ac7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.728099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c37566-5542-4492-a732-c9019229ea8e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.757206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:42.762211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.762826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.763100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.763365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.764436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.764767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ea5d7-f5b1-45f6-aef4-29f16516d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.765399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea5d7-f5b1-45f6-aef4-29f16516d25c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.772115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea5d7-f5b1-45f6-aef4-29f16516d25c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.772115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea5d7-f5b1-45f6-aef4-29f16516d25c None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.772335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.772432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ea5d7-f5b1-45f6-aef4-29f16516d25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.772524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 526/1043] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:42.772618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ea5d7-f5b1-45f6-aef4-29f16516d25c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:42.773698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:42.785246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 518/1044] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:26:42 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:26:42.896358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff966e-e0c4-45ed-8307-9b8c8b6f82ce None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:42.932875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36110f2f-d6f7-4f65-abdf-ca25db17f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:42.933595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36110f2f-d6f7-4f65-abdf-ca25db17f11a None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:42.933833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36110f2f-d6f7-4f65-abdf-ca25db17f11a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:42.934040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36110f2f-d6f7-4f65-abdf-ca25db17f11a None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:42.934688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36110f2f-d6f7-4f65-abdf-ca25db17f11a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:42.936125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36110f2f-d6f7-4f65-abdf-ca25db17f11a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:43.053956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:43.061085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 527/1045] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:26:42 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:44.274391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503254-908a-4372-a2e7-170902f05a82 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:44.274949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503254-908a-4372-a2e7-170902f05a82 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:44.274949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503254-908a-4372-a2e7-170902f05a82 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:44.276401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 519/1046] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:44.281344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:44.281752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:44.281940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:44.300693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:44.301900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:44.373257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 528/1047] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:44.644237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503254-908a-4372-a2e7-170902f05a82 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:44.747807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503254-908a-4372-a2e7-170902f05a82 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:44.781442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:44.782066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:44.782340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:44.782607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:44.793404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:44.798136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:44.799169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:44.800108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:44.805025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 520/1048] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Sep 9 11:26:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:44.806289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:44.913167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416a6d-4e90-484d-927d-156756e04c0b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:44.942508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:44.950906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:44.951513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:44.951789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:44.952057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:44.952914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:44.953326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:44.954710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a1571-7492-43a1-acea-f70fe18adefa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:44.967959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 529/1049] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:26:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:44.969283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.017718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e64a-9524-4782-9889-39ce03e04136 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.018076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e64a-9524-4782-9889-39ce03e04136 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.018271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e64a-9524-4782-9889-39ce03e04136 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.019618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 530/1050] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:45.025260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.025543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.025814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.029865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.043905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:45.045091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:45.079812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d307-65c8-488e-bdab-9d8afb21325c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.115337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 531/1051] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:45.116654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.117407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.117725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.118074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.131583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.133635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d46491fd-3130-48de-9fd2-d35d3dbb703e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:45.148048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:45.149086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:45.150487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:45.150487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:45.150487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:45.150487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 521/1052] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:45.154803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.260797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826195e-18ab-447c-9230-e92a7fdb2203 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.281357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.295925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.296525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.296855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.297070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.297741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:45.298038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.299391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.306728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc6b42-09a6-46ca-9f9c-2a877e6f33c4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.307220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc6b42-09a6-46ca-9f9c-2a877e6f33c4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.307307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc6b42-09a6-46ca-9f9c-2a877e6f33c4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.308754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 522/1053] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:45.315900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 532/1054] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:45.316042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.316042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.316042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.316839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.333224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:45.334414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:45.408080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 523/1055] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:45.408914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.428045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839ae16-7b24-47c4-b1e7-7acb97c6015e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.445090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.464975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.465635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.465915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.466180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.474457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.476037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:45.487308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:45.488322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:45.489351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 533/1056] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:45.494872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.518856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09cb2e-5c3e-4e08-a74b-f3e7cbe23499 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.538835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.559896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.560516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.560788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.561052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.561667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.563173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:45.573565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:45.574666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:45.575565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 524/1057] 10.222.0.64 () {56 vars in 1105 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:45.580701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.603615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cdadd-14fe-44c5-bdc8-adc9c96ffa14 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.649104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.649836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.650106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.650393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.651118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:45.651420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.653129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.676205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 534/1058] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:45.677051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.697520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.700478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621067d1-2d3d-4b89-8ad3-25e479924cb0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.733421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.734021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.734300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.734569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.735188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] RBAC: Adding query filter params (name=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:45.735489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.736849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.742122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 525/1059] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:45.742952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.777623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.781433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d126-d9ca-4dbc-a72f-6490f271e378 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.816199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.816808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.817078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.817368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.827711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.829265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:45.843230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:45.844351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:45.845761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:45.845761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:45.845761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:45.845761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 535/1060] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:45.845761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.847010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6160f-6724-4a81-a854-af8bd426b904 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.883282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.883899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.884172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.884541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.896973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:45.903180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:45.904359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 526/1061] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:45.905821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:45.931582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:45.948916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0f03a-43f1-42b5-a5fb-5df4f6fcb99a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:45.981606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:45.982192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:45.982462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:45.982732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:45.983335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] RBAC: Adding query filter params (type=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:45.983623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:45.985058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:45.989684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 536/1062] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:45.990452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.005156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750be90-793a-4f56-ace1-10409dc72255 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.010105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.038986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.039514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.039785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.040038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.040664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:46.040959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.042340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.057774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 527/1063] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:46.057774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.096872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3514a98-68cd-48c4-b47b-92a78fdf4e61 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.129902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.130494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.130770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.131043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.131698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:46.132637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.134230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.139623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.142608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 537/1064] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:46.143384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.156198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58fe3-dcec-4671-a094-dbca7360cdd4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.190168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.190768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.191045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.191309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.191959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.193371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.223703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.253529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8b7b-fbef-44bb-b331-df55bd2bbcc6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.281434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 528/1065] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:26:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:46.282341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.295184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.297021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.297391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.297659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.306104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.307584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:46.320986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:46.322280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:46.323473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:46.324263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 538/1066] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:46.330456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.404717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49b5a-e70f-4954-8b46-bd1d48fff3b8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.442479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.443122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.443510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.443779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] PATH_INFO: `/v3/users/04379698dac34f4c93b4bcda58080f77` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.456723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.461601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] RBAC: Authorizing `identity:get_user(user_id=04379698dac34f4c93b4bcda58080f77)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.463214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.464618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb0a6c-1c5d-466e-8adb-6badf71950a3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.470726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 529/1067] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/users/04379698dac34f4c93b4bcda58080f77 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:46.470960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.501001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.506782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.507395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.507673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.507940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.508626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:46.508931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.510406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.522479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 539/1068] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:46.529725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.599694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21030b98-e24d-439e-83ae-a6fb661de765 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.641224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.642009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.642289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.642558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.652368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4fb37-281c-4198-a814-82f1af7848e1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.688535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.689187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.689723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.689833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f354bf4e63d949ecbb86b123a7022293/roles/41418e9806ef437fb689c35400b95122` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.692022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=f354bf4e63d949ecbb86b123a7022293, role_id=41418e9806ef437fb689c35400b95122)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.693471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.714341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.717733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.719171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.765746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 540/1069] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:26:46 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/f354bf4e63d949ecbb86b123a7022293/roles/41418e9806ef437fb689c35400b95122 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:26:46.828976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 530/1070] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:26:46.830261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.899323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.947775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2de099-5c9d-4235-9a8d-0e0e4fbb86c0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.984804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63610d0-22d4-4960-8d70-6f1b082c90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.985454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63610d0-22d4-4960-8d70-6f1b082c90a8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.985732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63610d0-22d4-4960-8d70-6f1b082c90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.985997 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63610d0-22d4-4960-8d70-6f1b082c90a8 None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.987104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63610d0-22d4-4960-8d70-6f1b082c90a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e129767174624033bb17e5f1912f9ce3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.988872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63610d0-22d4-4960-8d70-6f1b082c90a8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.992522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 541/1071] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/projects/e129767174624033bb17e5f1912f9ce3 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:46.998542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:47.096312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:47.100657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72237877-d75e-42b7-9472-439f3ca3d5d7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:47.136937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:47.137561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:47.137837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:47.138098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:47.138808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=e129767174624033bb17e5f1912f9ce3, user.id=04379698dac34f4c93b4bcda58080f77) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:47.139107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:47.140511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d4a1-0484-497d-99d4-e5d5f83cda38 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:47.153391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 531/1072] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/role_assignments?user.id=04379698dac34f4c93b4bcda58080f77&scope.project.id=e129767174624033bb17e5f1912f9ce3&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:48.488622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be6782-efb9-4d0e-b806-37887ffafcdf None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:48.489173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be6782-efb9-4d0e-b806-37887ffafcdf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:48.489173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be6782-efb9-4d0e-b806-37887ffafcdf None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:48.491194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 542/1073] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:48.496500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ff933-13d7-4f24-b9b8-6d0208568c28 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:48.496915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ff933-13d7-4f24-b9b8-6d0208568c28 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:48.497090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ff933-13d7-4f24-b9b8-6d0208568c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:48.515046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ae3ff933-13d7-4f24-b9b8-6d0208568c28 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:48.516220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ae3ff933-13d7-4f24-b9b8-6d0208568c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:48.593257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 532/1074] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:48.863989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be6782-efb9-4d0e-b806-37887ffafcdf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:48.973450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be6782-efb9-4d0e-b806-37887ffafcdf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:48.994004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.009148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58676df-7ae4-4b11-9c53-b3bab34f7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.009762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58676df-7ae4-4b11-9c53-b3bab34f7847 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.010033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58676df-7ae4-4b11-9c53-b3bab34f7847 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.010297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58676df-7ae4-4b11-9c53-b3bab34f7847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.041617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346826-301f-4265-9d00-c069c7150921 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.041998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346826-301f-4265-9d00-c069c7150921 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.042343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346826-301f-4265-9d00-c069c7150921 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.043751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 533/1075] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:49.048724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.049132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.049339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.069673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:49.070873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:49.084850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58676df-7ae4-4b11-9c53-b3bab34f7847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:49.086437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58676df-7ae4-4b11-9c53-b3bab34f7847 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:49.149268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 534/1076] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:49.191829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 543/1077] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:26:49.197746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.224392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.301604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84965f0-b77e-4fd5-aaa1-0d9cb359fcd2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:49.311891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926106-9a96-40a2-a84e-3f0bb0231299 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.312176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926106-9a96-40a2-a84e-3f0bb0231299 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.312451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926106-9a96-40a2-a84e-3f0bb0231299 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.313827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 544/1078] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:49.318587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.319053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.319385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.337666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:49.338139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.338768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.338882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:49.339052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.339300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.350985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:49.352742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:49.353800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:49.370793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:49.375404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:49.376349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:49.376349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:49.376349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:49.376349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 535/1079] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:49.378284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.413947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 545/1080] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:26:49.414635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.455693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.482736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c380-152d-4c7e-ab69-30cc340ed32d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:49.518015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055345-c639-4b7b-86a2-ff0637db1026 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:49.521150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.521791 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.522066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.522335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.522972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:49.523271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:49.524624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:49.545242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 536/1081] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:49.562944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.563593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.563874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.564143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.576720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:49.581680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:49.582724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:49.583601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 546/1082] 10.222.0.64 () {56 vars in 1120 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:49.589086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.689328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.702902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.706274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a385920-8b03-460a-b244-6411d871f932 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:49.749264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.749875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.750170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.750420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.751080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:49.751375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:49.752729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:49.754561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.761955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 537/1083] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:49.767663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.806926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bc56-e272-49d4-b786-1386edb8c3f0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:49.847192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.847818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.848092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.848352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.860371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:49.865069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:49.866743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:49.867807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 547/1084] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:49.873191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.885341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a79a4-6b94-4add-b4eb-09c71c5c7b03 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:49.920186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:49.920809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:49.921081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:49.921375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:49.932344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:49.933818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:49.942275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:49.947653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:49.953196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:49.954240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:49.954240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:49.954240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:49.954240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 538/1085] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:49.954779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:49.973164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100013b-c006-4f8a-902c-8eb26fec4b2f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.002639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.007136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.007731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.008000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.008262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.008903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:50.009195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.010565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.018442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 548/1086] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:50.024814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.056926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33531d3-bfb3-4d56-be7b-36d0471f2ff2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.094952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.095544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.095815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.096077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.096702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:50.096998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.098378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.110055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 539/1087] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:50.116331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.124665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14121c14-5a88-4a7e-b3b7-a7effc688617 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.153658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.158524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.162986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.162986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.162986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] PATH_INFO: `/v3/users/04379698dac34f4c93b4bcda58080f77` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.162986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] RBAC: Authorizing `identity:get_user(user_id=04379698dac34f4c93b4bcda58080f77)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.162986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.163890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 549/1088] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/users/04379698dac34f4c93b4bcda58080f77 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:50.169677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.216914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2482f5-f09c-4a63-9b89-739d22bbe57a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.226103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.250560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.251182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.251457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.251722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.259442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.260872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.267486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f8b8-97e1-4b4a-ac51-c20e7dfce485 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:26:50.272141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:50.273089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:50.274098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 540/1089] 10.222.0.64 () {56 vars in 1093 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:50.278922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.301748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.302364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.302644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.303871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.304766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e129767174624033bb17e5f1912f9ce3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.306223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.307850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 550/1090] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/projects/e129767174624033bb17e5f1912f9ce3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:50.313553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.378048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.379266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd376b-41a1-4ef5-905a-56c483f232c6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.410616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958bcae-70f8-47a6-96fd-c76f558c74b6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.413843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.414445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.414725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.414992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.415707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:50.416008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.417455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.435420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 541/1091] 10.222.0.64 () {56 vars in 1133 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:50.440946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.445848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.446494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.446772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.447044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3/users/04379698dac34f4c93b4bcda58080f77/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.448921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] RBAC: Authorizing `identity:create_grant(project_id=e129767174624033bb17e5f1912f9ce3, user_id=04379698dac34f4c93b4bcda58080f77, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.450397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.467252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.535952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ff8e-0f68-4a50-aae6-4e7c4ab31864 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.548769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 551/1092] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:26:50 2022] PUT /identity/v3/projects/e129767174624033bb17e5f1912f9ce3/users/04379698dac34f4c93b4bcda58080f77/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:26:50.570162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.570764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.571285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.571738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.658465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.659880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.688352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.765436 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 542/1093] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:26:50.771176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:50.871065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa62858-b409-44a4-8af8-2b08912c29bd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:50.898100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:50.906224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:50.906839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:50.907115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:50.907384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:50.917866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:50.919504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:26:50.934119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:50.935267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:26:50.936332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:26:50.936332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:26:50.936332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:50.936727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 552/1094] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:50.940957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:51.040032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43330626-2920-4fb0-ad45-b982d30cfc36 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:51.064657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:51.073658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:51.074257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:51.074535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:51.074804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:51.076150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:51.076150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:51.077133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:51.088665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 543/1095] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:51.094213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:51.193459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26b091-3a33-41c8-9b86-ee3ccfcf805b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:51.227134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:51.227754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:51.228032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:51.228303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:51.235142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:51.236598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:26:51.248760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:51.249881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:26:51.251013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 553/1096] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:26:51.257770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:51.355193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01534e-639c-4d92-96a2-c246ef829717 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:51.388166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:51.388765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:51.389044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:51.389353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:51.390044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:51.390344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:51.391761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679266f-fde4-41e5-8019-1cf3aac5ade6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:51.404440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 544/1097] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:51.410917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:51.453595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:51.511175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811deabc-4f4d-4ed0-bcea-4e99f0acc953 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:51.544470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:51.545058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:51.545366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:51.545639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:51.546343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] RBAC: Adding query filter params (role.id=41418e9806ef437fb689c35400b95122, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=f354bf4e63d949ecbb86b123a7022293) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:51.546645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:51.548070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987fa9-bd8a-4d42-923a-6eba4f164a1e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:51.553805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 554/1098] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:51 2022] GET /identity/v3/role_assignments?user.id=f354bf4e63d949ecbb86b123a7022293&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=41418e9806ef437fb689c35400b95122 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:52.674200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36c97-a117-4003-bdba-d87acaddd34e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:52.674704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36c97-a117-4003-bdba-d87acaddd34e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:52.674798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36c97-a117-4003-bdba-d87acaddd34e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:52.676062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 545/1099] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:52.682038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:52.682438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:52.682579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:52.700674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:52.701878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:52.766325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 555/1100] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:53.036927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f36c97-a117-4003-bdba-d87acaddd34e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:53.084791 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:53.137897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f36c97-a117-4003-bdba-d87acaddd34e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:53.174671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:53.175416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:53.175693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:53.175959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:53.186347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:26:53.191048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:26:53.192166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:26:53.194204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 546/1101] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:26:53.198844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:53.230641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:53.294100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f0b0-8b7c-46d1-bb0a-bffacd037f12 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:53.326430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:53.327013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:53.327284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:53.327548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:53.328187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:53.328479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:53.329849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:53.337576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 556/1102] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:53.343497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:53.446551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e309f-a804-4064-bcd4-b92e89472ee8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:53.453104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:53.479362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:53.479979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:53.480258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:53.480529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] PATH_INFO: `/v3/users/04379698dac34f4c93b4bcda58080f77` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:53.481657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] RBAC: Authorizing `identity:get_user(user_id=04379698dac34f4c93b4bcda58080f77)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:53.483092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:53.484755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 547/1103] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:26:53 2022] GET /identity/v3/users/04379698dac34f4c93b4bcda58080f77 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:26:53.491246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:53.582832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:53.589102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118781a-40f9-48f7-8891-19ea93d490c4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:53.621904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:53.622492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:53.622765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:53.623032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:53.689552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:53.691032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:53.780829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:53.787143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 557/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:26:53.793299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:53.893118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c5c6-6df6-4a6d-941a-9bbdbf1ab866 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:53.925620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9814-5be4-40fc-942b-69b351fea4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:53.926234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9814-5be4-40fc-942b-69b351fea4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:53.926508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9814-5be4-40fc-942b-69b351fea4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:53.926772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9814-5be4-40fc-942b-69b351fea4a6 None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:53.928991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f9814-5be4-40fc-942b-69b351fea4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e129767174624033bb17e5f1912f9ce3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:53.931710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f9814-5be4-40fc-942b-69b351fea4a6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:53.934497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 548/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:26:53 2022] GET /identity/v3/projects/e129767174624033bb17e5f1912f9ce3 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:53.940682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:54.042132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170452b-e7c7-430b-8b44-cf2eed76d153 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:54.077450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:54.078039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:54.078315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:54.078583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:54.079284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=e129767174624033bb17e5f1912f9ce3, user.id=04379698dac34f4c93b4bcda58080f77) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:26:54.079585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:54.081004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc92df-95aa-4107-a7d6-fb9a9b0d2382 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:54.086662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 558/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:26:53 2022] GET /identity/v3/role_assignments?user.id=04379698dac34f4c93b4bcda58080f77&scope.project.id=e129767174624033bb17e5f1912f9ce3&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:56.258280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4f096-930f-4675-98a3-6b0336ec8194 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:56.258837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4f096-930f-4675-98a3-6b0336ec8194 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:56.258837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4f096-930f-4675-98a3-6b0336ec8194 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:56.260129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 549/1107] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:56.265241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:56.265633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:56.265784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:56.283328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:56.284487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:56.337965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:56.349010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 559/1108] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:56.615958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4f096-930f-4675-98a3-6b0336ec8194 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:56.659462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:56.715043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4f096-930f-4675-98a3-6b0336ec8194 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:56.747347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d444d-1b56-4938-8fb1-4e15a78dc7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:56.747950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d444d-1b56-4938-8fb1-4e15a78dc7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:56.748222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d444d-1b56-4938-8fb1-4e15a78dc7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:56.748487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d444d-1b56-4938-8fb1-4e15a78dc7c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:56.749592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d444d-1b56-4938-8fb1-4e15a78dc7c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:56.750999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d444d-1b56-4938-8fb1-4e15a78dc7c3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:56.752525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 550/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:56.758394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:56.855307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bf73-9291-440f-b690-2d4cd1165f30 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:56.888343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a786df-27dc-494c-945b-e1182d6641b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:56.888867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a786df-27dc-494c-945b-e1182d6641b6 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:56.889142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a786df-27dc-494c-945b-e1182d6641b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:56.889440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a786df-27dc-494c-945b-e1182d6641b6 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:56.890090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a786df-27dc-494c-945b-e1182d6641b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:56.891502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a786df-27dc-494c-945b-e1182d6641b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:56.993610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 560/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:26:56 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:26:59.172792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2f18-a6fa-4418-a7e6-7d2881efb273 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:59.173343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2f18-a6fa-4418-a7e6-7d2881efb273 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:59.173462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2f18-a6fa-4418-a7e6-7d2881efb273 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:59.174693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 551/1111] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:59.180567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:59.180986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:59.181103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:59.199317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:59.200477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:59.241313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:59.266132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 561/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:26:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:26:59.540649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2f18-a6fa-4418-a7e6-7d2881efb273 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:59.642565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2f18-a6fa-4418-a7e6-7d2881efb273 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:59.653383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:59.675769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:59.676974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:59.677326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:59.677601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] PATH_INFO: `/v3/roles/b06842f53bac40fc821b025679907505` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:59.678992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] RBAC: Authorizing `identity:get_role(role_id=b06842f53bac40fc821b025679907505)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:59.680349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:59.682089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 552/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:26:59 2022] GET /identity/v3/roles/b06842f53bac40fc821b025679907505 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:59.687506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:59.784000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc83674-6b43-48a9-9329-a8afb12718ea None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:59.817277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:59.817829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:59.818098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:59.818361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] PATH_INFO: `/v3/users/64dda0526b6b4299aa8c3b455e459261` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:59.830842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] RBAC: Authorizing `identity:get_user(user_id=64dda0526b6b4299aa8c3b455e459261)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:59.832293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:59.833987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 562/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:26:59 2022] GET /identity/v3/users/64dda0526b6b4299aa8c3b455e459261 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:26:59.839720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:59.935706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ff58f-d956-47ed-85ee-45040cf5b7f0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:59.967680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:59.968342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:59.968622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:59.968889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:00.013009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:00.033595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:00.035023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:00.132731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 553/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:26:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:00.138732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:00.172234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:00.236530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941412-1b42-40ec-9e14-56f4358fc15e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:00.270030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c4715-c833-4021-9af8-4aaf024469ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:00.270634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4715-c833-4021-9af8-4aaf024469ce None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:00.270911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4715-c833-4021-9af8-4aaf024469ce None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:00.271179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4715-c833-4021-9af8-4aaf024469ce None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:00.272276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c4715-c833-4021-9af8-4aaf024469ce None admin] RBAC: Authorizing `identity:get_project(project_id=e129767174624033bb17e5f1912f9ce3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:00.273736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c4715-c833-4021-9af8-4aaf024469ce None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:00.275353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 563/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:00 2022] GET /identity/v3/projects/e129767174624033bb17e5f1912f9ce3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:00.281450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:00.356309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:00.377820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0a77-a25b-43a6-8186-f9fff33d0e84 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:00.411921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:00.412449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:00.412719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:00.412979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:00.413714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] RBAC: Adding query filter params (role.id=b06842f53bac40fc821b025679907505, scope.project.id=e129767174624033bb17e5f1912f9ce3, user.id=64dda0526b6b4299aa8c3b455e459261) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:00.414011 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:00.415583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70a26-47d8-4e0b-8fb6-77293974d6f1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:00.420866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 554/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:27:00 2022] GET /identity/v3/role_assignments?user.id=64dda0526b6b4299aa8c3b455e459261&scope.project.id=e129767174624033bb17e5f1912f9ce3&role.id=b06842f53bac40fc821b025679907505 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:02.523578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe4f3-8a7f-4d62-92a9-11a2d9383d92 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:02.524145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe4f3-8a7f-4d62-92a9-11a2d9383d92 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:02.524145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe4f3-8a7f-4d62-92a9-11a2d9383d92 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:02.525489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 564/1118] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:02.530501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:02.530907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:02.531024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:02.549102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:02.550331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:02.614029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 555/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:02.888469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe4f3-8a7f-4d62-92a9-11a2d9383d92 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:02.987451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe4f3-8a7f-4d62-92a9-11a2d9383d92 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:02.988925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:03.022007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:03.022619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:03.022893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:03.023160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] PATH_INFO: `/v3/roles/b06842f53bac40fc821b025679907505` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:03.024525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] RBAC: Authorizing `identity:get_role(role_id=b06842f53bac40fc821b025679907505)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:03.025900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:03.027207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 565/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:02 2022] GET /identity/v3/roles/b06842f53bac40fc821b025679907505 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:03.033054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:03.100703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:03.128162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3038-9fe4-43aa-9544-af339c72cdc3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:03.161718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:03.162264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:03.162535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:03.162802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] PATH_INFO: `/v3/users/64dda0526b6b4299aa8c3b455e459261` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:03.163882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] RBAC: Authorizing `identity:get_user(user_id=64dda0526b6b4299aa8c3b455e459261)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:03.165310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:03.166854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 556/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:03 2022] GET /identity/v3/users/64dda0526b6b4299aa8c3b455e459261 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:03.172628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:03.267934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e0775-7c06-4239-b71d-6c69666a02b5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:03.300553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52366f0a-8248-4a96-9eeb-f4c046f5b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:03.301149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366f0a-8248-4a96-9eeb-f4c046f5b224 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:03.301448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366f0a-8248-4a96-9eeb-f4c046f5b224 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:03.301715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366f0a-8248-4a96-9eeb-f4c046f5b224 None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:03.302786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366f0a-8248-4a96-9eeb-f4c046f5b224 None admin] RBAC: Authorizing `identity:get_project(project_id=e129767174624033bb17e5f1912f9ce3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:03.304201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52366f0a-8248-4a96-9eeb-f4c046f5b224 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:03.305818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 566/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:03 2022] GET /identity/v3/projects/e129767174624033bb17e5f1912f9ce3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:03.311611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:03.408400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad8f58-03e4-4e18-8315-a40ff2494784 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:03.442019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d193a-f484-4e0e-804c-b99eb0dd1700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:03.442587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d193a-f484-4e0e-804c-b99eb0dd1700 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:03.442859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d193a-f484-4e0e-804c-b99eb0dd1700 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:03.443125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d193a-f484-4e0e-804c-b99eb0dd1700 None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3/users/64dda0526b6b4299aa8c3b455e459261/roles/b06842f53bac40fc821b025679907505` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:03.445204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d193a-f484-4e0e-804c-b99eb0dd1700 None admin] RBAC: Authorizing `identity:create_grant(project_id=e129767174624033bb17e5f1912f9ce3, user_id=64dda0526b6b4299aa8c3b455e459261, role_id=b06842f53bac40fc821b025679907505)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:03.446633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d193a-f484-4e0e-804c-b99eb0dd1700 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:03.576297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:03.580722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 557/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:27:03 2022] PUT /identity/v3/projects/e129767174624033bb17e5f1912f9ce3/users/64dda0526b6b4299aa8c3b455e459261/roles/b06842f53bac40fc821b025679907505 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:27:05.693840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b16d-095b-4de2-bd36-87c1b756e044 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:05.694332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b16d-095b-4de2-bd36-87c1b756e044 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:05.694422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b16d-095b-4de2-bd36-87c1b756e044 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:05.695695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 567/1124] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:05.700941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e887-f32b-4763-b463-6704b94affde None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:05.701353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e887-f32b-4763-b463-6704b94affde None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:05.701565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e887-f32b-4763-b463-6704b94affde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:05.719797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1a74e887-f32b-4763-b463-6704b94affde None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:05.720961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1a74e887-f32b-4763-b463-6704b94affde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:05.786106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 558/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:27:06.056341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b16d-095b-4de2-bd36-87c1b756e044 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:06.096897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:06.155724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b16d-095b-4de2-bd36-87c1b756e044 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:06.188417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:06.189023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:06.189326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:06.189598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] PATH_INFO: `/v3/roles/b06842f53bac40fc821b025679907505` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:06.191597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] RBAC: Authorizing `identity:get_role(role_id=b06842f53bac40fc821b025679907505)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:06.192954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:06.194283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 568/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:06 2022] GET /identity/v3/roles/b06842f53bac40fc821b025679907505 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:06.200026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e887-f32b-4763-b463-6704b94affde None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:06.295648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e887-f32b-4763-b463-6704b94affde None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:06.324685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:06.330310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:06.331507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:06.331780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:06.332048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] PATH_INFO: `/v3/users/64dda0526b6b4299aa8c3b455e459261` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:06.333141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] RBAC: Authorizing `identity:get_user(user_id=64dda0526b6b4299aa8c3b455e459261)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:06.334582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:06.339470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 559/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:06 2022] GET /identity/v3/users/64dda0526b6b4299aa8c3b455e459261 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:06.342023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:06.437576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30761736-95af-4bda-ad81-f503143c8be8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:06.445285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:06.470258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:06.470839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:06.471112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:06.471395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:06.536370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:06.537842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:06.632213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 569/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:27:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:06.638125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:06.733872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef92098-227d-4107-9e4e-4daf7a203c9a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:06.767935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41124e0-246d-48f4-95c7-64eda5989843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:06.768643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41124e0-246d-48f4-95c7-64eda5989843 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:06.769014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41124e0-246d-48f4-95c7-64eda5989843 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:06.769320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41124e0-246d-48f4-95c7-64eda5989843 None admin] PATH_INFO: `/v3/projects/e129767174624033bb17e5f1912f9ce3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:06.770426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41124e0-246d-48f4-95c7-64eda5989843 None admin] RBAC: Authorizing `identity:get_project(project_id=e129767174624033bb17e5f1912f9ce3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:06.771847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41124e0-246d-48f4-95c7-64eda5989843 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:06.773480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 560/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:06 2022] GET /identity/v3/projects/e129767174624033bb17e5f1912f9ce3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:06.779597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:06.788140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:06.883666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a0bf6-6baf-4c1d-b84b-1b14a5ba4171 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:06.917426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:06.918009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:06.918282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:06.918547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:06.919250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] RBAC: Adding query filter params (role.id=b06842f53bac40fc821b025679907505, scope.project.id=e129767174624033bb17e5f1912f9ce3, user.id=64dda0526b6b4299aa8c3b455e459261) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:06.919550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:06.920963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc068eb-c1b7-49ac-9ae0-b5a2a0df57f2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:06.927400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 570/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:27:06 2022] GET /identity/v3/role_assignments?user.id=64dda0526b6b4299aa8c3b455e459261&scope.project.id=e129767174624033bb17e5f1912f9ce3&role.id=b06842f53bac40fc821b025679907505 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:09.119065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de6e65-987b-4aa6-9b27-b7e437500b74 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:09.119600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de6e65-987b-4aa6-9b27-b7e437500b74 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:09.119600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de6e65-987b-4aa6-9b27-b7e437500b74 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:09.120929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 561/1131] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:09.126253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:09.126648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:09.126796 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:09.144864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:09.146077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:09.206663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:09.210991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 571/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:09.495311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de6e65-987b-4aa6-9b27-b7e437500b74 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:09.559903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:09.593579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de6e65-987b-4aa6-9b27-b7e437500b74 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:09.627078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d7588-6d0c-41db-b300-1062030f9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:09.627779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7588-6d0c-41db-b300-1062030f9411 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:09.628054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7588-6d0c-41db-b300-1062030f9411 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:09.628317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7588-6d0c-41db-b300-1062030f9411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:09.629423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7588-6d0c-41db-b300-1062030f9411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:09.630826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7588-6d0c-41db-b300-1062030f9411 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:09.632364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 562/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:09.638069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:09.733599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252c17-215f-4a96-b5c0-7564ec7547b8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:09.766084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e71ba-a9b5-4a6e-b025-0206c65d59b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:09.766606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e71ba-a9b5-4a6e-b025-0206c65d59b6 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:09.766880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e71ba-a9b5-4a6e-b025-0206c65d59b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:09.767145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e71ba-a9b5-4a6e-b025-0206c65d59b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:09.768662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e71ba-a9b5-4a6e-b025-0206c65d59b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:09.770103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e71ba-a9b5-4a6e-b025-0206c65d59b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:09.875818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 572/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:27:09 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:27:12.070050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca908-222a-4137-a2d2-c61b94dc764f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:12.070582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca908-222a-4137-a2d2-c61b94dc764f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:12.070582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca908-222a-4137-a2d2-c61b94dc764f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:12.071905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 563/1135] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:12.077180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:12.077610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:12.077718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:12.095978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:12.097132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:12.141631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:12.160869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 573/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:27:12.433430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca908-222a-4137-a2d2-c61b94dc764f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:12.532477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca908-222a-4137-a2d2-c61b94dc764f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:12.565123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057906d2-b877-4f3f-84f9-50aab2e79eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:12.565758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057906d2-b877-4f3f-84f9-50aab2e79eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:12.566031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057906d2-b877-4f3f-84f9-50aab2e79eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:12.566291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057906d2-b877-4f3f-84f9-50aab2e79eb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:12.567370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057906d2-b877-4f3f-84f9-50aab2e79eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:12.568775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057906d2-b877-4f3f-84f9-50aab2e79eb0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:12.570341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 564/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:27:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:12.576106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:12.672422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347bec-a966-4538-9c92-73a9f1d93fe1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:12.704414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227db7ec-60dc-4c88-88a6-4676bea89aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:12.705548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227db7ec-60dc-4c88-88a6-4676bea89aee None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:12.705823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227db7ec-60dc-4c88-88a6-4676bea89aee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:12.706089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227db7ec-60dc-4c88-88a6-4676bea89aee None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:12.706719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227db7ec-60dc-4c88-88a6-4676bea89aee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:12.708131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227db7ec-60dc-4c88-88a6-4676bea89aee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:12.774148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 574/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:27:12 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:27:14.957645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111502-e9fd-4704-872f-133ada542470 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:14.958228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111502-e9fd-4704-872f-133ada542470 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:14.958228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111502-e9fd-4704-872f-133ada542470 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:14.959508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 565/1139] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:14.964612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:14.965050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:14.965152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:14.983385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:14.984551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:15.013138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:15.048674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 575/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:15.330773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111502-e9fd-4704-872f-133ada542470 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:15.333597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:15.434421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111502-e9fd-4704-872f-133ada542470 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:15.469140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:15.469858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:15.470108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:15.470372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:15.480014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:27:15.484687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:15.486468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:27:15.487772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 566/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:15.492639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:15.588265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ee67-ae8e-4771-902a-8aed636d24cb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:15.622216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:15.622805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:15.623076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:15.623348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:15.623996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:15.624288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:15.625676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:15.634743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 576/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:15.640699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:15.700917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:15.738788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fefdb8-e088-4bcc-b56c-0d8b617457ff None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:15.772326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:15.772933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:15.773236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:15.773508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] PATH_INFO: `/v3/users/b8d3a332bf6a4a19ab21591da6ff16b1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:15.786652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d3a332bf6a4a19ab21591da6ff16b1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:15.788079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:15.789687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 567/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:15 2022] GET /identity/v3/users/b8d3a332bf6a4a19ab21591da6ff16b1 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:15.795378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:15.825360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:15.893292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39ea4-550b-467c-8efd-aed06be6983e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:15.925974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:15.926556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:15.926829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:15.927093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:15.991300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:15.992735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:16.020992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:16.088366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 577/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:27:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:16.094427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:16.191247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52344698-a730-4deb-a855-e3c014f5de07 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:16.210370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:16.223764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a50bf-5416-41f6-99a8-11d6cdf6fc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:16.224378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a50bf-5416-41f6-99a8-11d6cdf6fc20 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:16.224653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a50bf-5416-41f6-99a8-11d6cdf6fc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:16.224922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a50bf-5416-41f6-99a8-11d6cdf6fc20 None admin] PATH_INFO: `/v3/projects/34629a6159e846a4a5f3849b8dce7bbe` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:16.226041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a50bf-5416-41f6-99a8-11d6cdf6fc20 None admin] RBAC: Authorizing `identity:get_project(project_id=34629a6159e846a4a5f3849b8dce7bbe)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:16.227461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a50bf-5416-41f6-99a8-11d6cdf6fc20 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:16.229108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 568/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:16 2022] GET /identity/v3/projects/34629a6159e846a4a5f3849b8dce7bbe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:16.235815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:16.332783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8852-6215-4407-a19e-2a6a0d0b1a9c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:16.361589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:16.367413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:16.370182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:16.370182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:16.370182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:16.370182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=34629a6159e846a4a5f3849b8dce7bbe, user.id=b8d3a332bf6a4a19ab21591da6ff16b1) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:16.370182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:16.370979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ab42-6cf1-403a-a3f4-db43810c4d66 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:16.376496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 578/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:27:16 2022] GET /identity/v3/role_assignments?user.id=b8d3a332bf6a4a19ab21591da6ff16b1&scope.project.id=34629a6159e846a4a5f3849b8dce7bbe&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:18.542877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f220088-956d-4e38-9443-01640bb1862e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:18.543406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f220088-956d-4e38-9443-01640bb1862e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:18.543406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f220088-956d-4e38-9443-01640bb1862e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:18.544736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 569/1147] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:18.550243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:18.550659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:18.550784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:18.568778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:18.569981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:18.635457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 579/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:18.907128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f220088-956d-4e38-9443-01640bb1862e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:19.005846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f220088-956d-4e38-9443-01640bb1862e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:19.038743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:19.039353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:19.039627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:19.039891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:19.050035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:27:19.054787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:19.055882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:27:19.056928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 570/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:19.061937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:19.157408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd8160-d3ad-4b9f-a1bf-38df63c3b8f1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:19.179403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:19.189645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:19.190230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:19.190506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:19.190774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:19.191419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:19.191715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:19.193080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:19.200864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 580/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:19.207381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:19.255996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:19.310884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05a10-c775-48f6-8013-483ef72c331d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:19.343071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:19.343671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:19.344543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:19.344882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] PATH_INFO: `/v3/users/b8d3a332bf6a4a19ab21591da6ff16b1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:19.346015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] RBAC: Authorizing `identity:get_user(user_id=b8d3a332bf6a4a19ab21591da6ff16b1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:19.347422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:19.348957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 571/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:19 2022] GET /identity/v3/users/b8d3a332bf6a4a19ab21591da6ff16b1 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:19.354717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:19.451097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0734-f4d1-4ffe-853e-8c50f057dcb3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:19.483441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12eca7-ec78-4ca2-b85b-e72fe8a01bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:19.484038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12eca7-ec78-4ca2-b85b-e72fe8a01bcc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:19.484307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12eca7-ec78-4ca2-b85b-e72fe8a01bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:19.484602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12eca7-ec78-4ca2-b85b-e72fe8a01bcc None admin] PATH_INFO: `/v3/projects/34629a6159e846a4a5f3849b8dce7bbe` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:19.485782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12eca7-ec78-4ca2-b85b-e72fe8a01bcc None admin] RBAC: Authorizing `identity:get_project(project_id=34629a6159e846a4a5f3849b8dce7bbe)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:19.487190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12eca7-ec78-4ca2-b85b-e72fe8a01bcc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:19.488767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 581/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:19 2022] GET /identity/v3/projects/34629a6159e846a4a5f3849b8dce7bbe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:19.494896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:19.592152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4420-1608-4a74-a9f7-86f2768d568a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:19.608025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:19.626364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5de0-6f37-43a2-acdd-f3d5b2701974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:19.627023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5de0-6f37-43a2-acdd-f3d5b2701974 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:19.627643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5de0-6f37-43a2-acdd-f3d5b2701974 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:19.627643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5de0-6f37-43a2-acdd-f3d5b2701974 None admin] PATH_INFO: `/v3/projects/34629a6159e846a4a5f3849b8dce7bbe/users/b8d3a332bf6a4a19ab21591da6ff16b1/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:19.629475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5de0-6f37-43a2-acdd-f3d5b2701974 None admin] RBAC: Authorizing `identity:create_grant(project_id=34629a6159e846a4a5f3849b8dce7bbe, user_id=b8d3a332bf6a4a19ab21591da6ff16b1, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:19.630910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5de0-6f37-43a2-acdd-f3d5b2701974 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:19.703054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 572/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:27:19 2022] PUT /identity/v3/projects/34629a6159e846a4a5f3849b8dce7bbe/users/b8d3a332bf6a4a19ab21591da6ff16b1/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:27:21.827325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036bae8-6ac0-4dbd-8e69-e36d1c450fd0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:21.828070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036bae8-6ac0-4dbd-8e69-e36d1c450fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:21.828070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036bae8-6ac0-4dbd-8e69-e36d1c450fd0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:21.829295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 582/1154] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:21.834410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:21.834932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:21.834932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:21.853495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:21.854665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:21.920631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 573/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:22.186772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036bae8-6ac0-4dbd-8e69-e36d1c450fd0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:22.241488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:22.285954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036bae8-6ac0-4dbd-8e69-e36d1c450fd0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:22.317607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:22.318206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:22.318477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:22.318739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:22.329495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:27:22.334107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:22.335230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:27:22.336283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 583/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:22.341347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:22.441359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a88611-b993-4cbd-8ea6-359a2b86758b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:22.448204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:22.475843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:22.476441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:22.476717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:22.476982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:22.477667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:22.477962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:22.479335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:22.487705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 574/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:22.494099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:22.591598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc5c4-8dd2-49ac-ac86-cef91db8d406 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:22.604709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:22.625618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:22.626780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:22.626780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:22.626780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] PATH_INFO: `/v3/users/b8d3a332bf6a4a19ab21591da6ff16b1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:22.627846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d3a332bf6a4a19ab21591da6ff16b1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:22.629311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:22.630864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 584/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:22 2022] GET /identity/v3/users/b8d3a332bf6a4a19ab21591da6ff16b1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:22.636663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:22.732993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6dd5-7d92-437b-a0a3-2171c8f275a3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:22.765941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:22.766527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:22.766798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:22.767062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:22.799749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:22.830525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:22.832066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:22.927545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 575/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:27:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:22.933710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:23.031112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b7946-0e95-49be-98cb-8fdc7024e055 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:23.062436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e4b5-8e53-418b-a426-5cec783127a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:23.063044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e4b5-8e53-418b-a426-5cec783127a3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:23.063316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e4b5-8e53-418b-a426-5cec783127a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:23.063581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e4b5-8e53-418b-a426-5cec783127a3 None admin] PATH_INFO: `/v3/projects/34629a6159e846a4a5f3849b8dce7bbe` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:23.064659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e4b5-8e53-418b-a426-5cec783127a3 None admin] RBAC: Authorizing `identity:get_project(project_id=34629a6159e846a4a5f3849b8dce7bbe)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:23.066097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e4b5-8e53-418b-a426-5cec783127a3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:23.067682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 585/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:22 2022] GET /identity/v3/projects/34629a6159e846a4a5f3849b8dce7bbe => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:23.073816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:23.137659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:23.169605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7e5c7-5400-4caa-8957-6e280780d31f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:23.201699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:23.202284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:23.203058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:23.203327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:23.204021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=34629a6159e846a4a5f3849b8dce7bbe, user.id=b8d3a332bf6a4a19ab21591da6ff16b1) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:23.204321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:23.205748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ae046-3199-421c-9a37-83ea5ba805cf None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:23.211271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 576/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:27:23 2022] GET /identity/v3/role_assignments?user.id=b8d3a332bf6a4a19ab21591da6ff16b1&scope.project.id=34629a6159e846a4a5f3849b8dce7bbe&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:25.347300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760d3a-2029-4398-92fa-2e2ee0206024 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:25.347830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760d3a-2029-4398-92fa-2e2ee0206024 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:25.347830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760d3a-2029-4398-92fa-2e2ee0206024 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:25.349160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 586/1162] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:25.354463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:25.354842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:25.355004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:25.374416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:25.375960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:25.441029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 577/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:25.712714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760d3a-2029-4398-92fa-2e2ee0206024 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:25.763204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:25.813177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760d3a-2029-4398-92fa-2e2ee0206024 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:25.845680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:25.846275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:25.846575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:25.846845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:25.911823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:25.913184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:25.959461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:26.007369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 587/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:27:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:26.013257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:26.072467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:26.109123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ca85-69c7-4402-9602-94ff28900055 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:26.142522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:26.143130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:26.143404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:26.143669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:26.150074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:26.151499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-39aaa1b4-449e-40fa-b884-60bae2b18c05 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:26.162569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:26.163786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:27:26.164653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 578/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:27:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:26.169501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:26.264903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0292-2de1-47f5-aea0-d2abe85d4dbc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:26.298472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:26.299041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:26.299312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:26.299574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:26.300191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:26.300484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:26.301860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1904f4e-d4ed-4b0b-b68a-ba0e7bc7a29e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:26.308667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 588/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Fri Sep 9 11:27:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:28.646374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd86c-0af8-41a3-a01f-db5d3620bc5d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:28.646815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd86c-0af8-41a3-a01f-db5d3620bc5d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:28.646904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd86c-0af8-41a3-a01f-db5d3620bc5d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:28.648233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 579/1167] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:28.653376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71e3c-16d4-456d-b643-97fe5fdfd725 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:28.653786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71e3c-16d4-456d-b643-97fe5fdfd725 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:28.653977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71e3c-16d4-456d-b643-97fe5fdfd725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:28.671907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1ab71e3c-16d4-456d-b643-97fe5fdfd725 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:28.673075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1ab71e3c-16d4-456d-b643-97fe5fdfd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:28.682016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:28.737089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 589/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:29.004734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd86c-0af8-41a3-a01f-db5d3620bc5d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:29.108302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd86c-0af8-41a3-a01f-db5d3620bc5d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:29.129357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:29.140576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712dad6-fc7c-47ea-9db2-bfc030c26fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:29.141163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712dad6-fc7c-47ea-9db2-bfc030c26fd4 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:29.141463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712dad6-fc7c-47ea-9db2-bfc030c26fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:29.141728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712dad6-fc7c-47ea-9db2-bfc030c26fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:29.142376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712dad6-fc7c-47ea-9db2-bfc030c26fd4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:29.143716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712dad6-fc7c-47ea-9db2-bfc030c26fd4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:29.216445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 580/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Fri Sep 9 11:27:29 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:27:31.403724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53131-8fca-46c9-8daf-615ab3318fc2 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:31.404526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53131-8fca-46c9-8daf-615ab3318fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:31.404526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e53131-8fca-46c9-8daf-615ab3318fc2 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:31.405841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 590/1170] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:31.411234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:31.411622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:31.411784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:31.430546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:31.431732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:31.496716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 581/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:31.768470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53131-8fca-46c9-8daf-615ab3318fc2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:31.865869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e53131-8fca-46c9-8daf-615ab3318fc2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:31.898320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6c74-7288-4a99-8406-0fab3a732406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:31.898930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6c74-7288-4a99-8406-0fab3a732406 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:31.899203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6c74-7288-4a99-8406-0fab3a732406 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:31.899470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6c74-7288-4a99-8406-0fab3a732406 None admin] PATH_INFO: `/v3/domains/0dd7aaabc21d42a3a78f71239419308d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:31.909785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6c74-7288-4a99-8406-0fab3a732406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0dd7aaabc21d42a3a78f71239419308d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:31.911214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6c74-7288-4a99-8406-0fab3a732406 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:31.912763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 591/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Fri Sep 9 11:27:31 2022] GET /identity/v3/domains/0dd7aaabc21d42a3a78f71239419308d => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:31.918824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:32.014643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39023aa5-d841-420b-8eeb-54e88d903187 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:32.027102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:32.049570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866415-4a6e-4037-9bbd-90ff16e25582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:32.050179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866415-4a6e-4037-9bbd-90ff16e25582 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:32.050635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866415-4a6e-4037-9bbd-90ff16e25582 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:32.051216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866415-4a6e-4037-9bbd-90ff16e25582 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:32.051901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866415-4a6e-4037-9bbd-90ff16e25582 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:32.053349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866415-4a6e-4037-9bbd-90ff16e25582 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:32.140143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 582/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:27:31 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:27:34.325742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562be2-48ec-4b7f-ae0a-35921fd52582 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:34.326276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562be2-48ec-4b7f-ae0a-35921fd52582 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:34.326276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562be2-48ec-4b7f-ae0a-35921fd52582 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:34.327631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 592/1174] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:34.332899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:34.333283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:34.333474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:34.350887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:34.352058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:34.415890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 583/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:34.684386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562be2-48ec-4b7f-ae0a-35921fd52582 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:34.688420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:34.783199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562be2-48ec-4b7f-ae0a-35921fd52582 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:34.815669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc844cb-f448-4d46-a758-4e1ef3849921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:34.816270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc844cb-f448-4d46-a758-4e1ef3849921 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:34.816542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc844cb-f448-4d46-a758-4e1ef3849921 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:34.816805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc844cb-f448-4d46-a758-4e1ef3849921 None admin] PATH_INFO: `/v3/domains/0dd7aaabc21d42a3a78f71239419308d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:34.817915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc844cb-f448-4d46-a758-4e1ef3849921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0dd7aaabc21d42a3a78f71239419308d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:34.819327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc844cb-f448-4d46-a758-4e1ef3849921 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:34.820857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 593/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Fri Sep 9 11:27:34 2022] GET /identity/v3/domains/0dd7aaabc21d42a3a78f71239419308d => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:34.826637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:34.918300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:34.925165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bb6d7-3574-4f37-9973-460a8d1ea551 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:34.958547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c44e5-06d3-41eb-9da6-9690290c46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:34.959138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c44e5-06d3-41eb-9da6-9690290c46b1 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:34.959417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c44e5-06d3-41eb-9da6-9690290c46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:34.959685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c44e5-06d3-41eb-9da6-9690290c46b1 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:34.960321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c44e5-06d3-41eb-9da6-9690290c46b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:34.961914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c44e5-06d3-41eb-9da6-9690290c46b1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:35.064942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 584/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:27:34 2022] POST /identity/v3/users => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:27:37.239999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb499e-8375-4ddf-9c9e-0ca45fa1964c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:37.240533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb499e-8375-4ddf-9c9e-0ca45fa1964c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:37.240533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb499e-8375-4ddf-9c9e-0ca45fa1964c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:37.242047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 594/1178] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:37.247824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:37.248231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:37.248355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:37.265994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:37.267167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:37.332318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 585/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:37.599752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb499e-8375-4ddf-9c9e-0ca45fa1964c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:37.669424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:37.698239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb499e-8375-4ddf-9c9e-0ca45fa1964c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:37.730177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:37.731474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:37.731856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:37.732126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:37.743460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:27:37.748318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:37.749525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:27:37.750579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 595/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:37.755498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:37.831527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:37.849839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37886-6e9f-482e-8556-fe7786c38b84 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:37.883435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:37.884025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:37.884297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:37.884563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:37.885207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:37.885527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:37.887403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:37.895497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 586/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:37.901600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:38.001713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510803c-ddee-4637-82b2-68fc67f58469 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:38.029865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:38.034572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:38.035185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:38.035461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:38.035729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] PATH_INFO: `/v3/users/173b8b26bf91482795046082d40228f0` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:38.049068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] RBAC: Authorizing `identity:get_user(user_id=173b8b26bf91482795046082d40228f0)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:38.050537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:38.052114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 596/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:37 2022] GET /identity/v3/users/173b8b26bf91482795046082d40228f0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:38.057930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:38.157585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9ab1-ddc0-4dc9-9c5b-f16a0bb6845b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:38.191222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:38.191812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:38.192085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:38.192351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:38.204126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:38.258906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:38.260333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:38.356736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 587/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:27:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:38.363057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:38.457421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593e4b7-bf3c-4f3a-b5d4-ef13e815f112 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:38.490267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8eba2-5b53-47fb-82b2-5748e834056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:38.490863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8eba2-5b53-47fb-82b2-5748e834056b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:38.491132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8eba2-5b53-47fb-82b2-5748e834056b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:38.491396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8eba2-5b53-47fb-82b2-5748e834056b None admin] PATH_INFO: `/v3/projects/fd7359657ed74c64b4dfc052f30b8112` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:38.492462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8eba2-5b53-47fb-82b2-5748e834056b None admin] RBAC: Authorizing `identity:get_project(project_id=fd7359657ed74c64b4dfc052f30b8112)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:38.493903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8eba2-5b53-47fb-82b2-5748e834056b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:38.495467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 597/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:38 2022] GET /identity/v3/projects/fd7359657ed74c64b4dfc052f30b8112 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:38.501672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:38.542976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:38.597922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84feb80c-7de4-4a7a-b3ea-1e2cfdd8352c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:38.632099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:38.632696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:38.632972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:38.633265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:38.633981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=fd7359657ed74c64b4dfc052f30b8112, user.id=173b8b26bf91482795046082d40228f0) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:38.634284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:38.635698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94fde-2a01-4d59-b930-b6ed876884c3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:38.641653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 588/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:27:38 2022] GET /identity/v3/role_assignments?user.id=173b8b26bf91482795046082d40228f0&scope.project.id=fd7359657ed74c64b4dfc052f30b8112&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:40.748810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc6ef-2d26-4806-9387-386aad501799 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:40.749377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc6ef-2d26-4806-9387-386aad501799 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:40.749377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc6ef-2d26-4806-9387-386aad501799 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:40.750682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 598/1186] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:40.755693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:40.756111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:40.756217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:40.774512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:40.775685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:40.839293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 589/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:41.109271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdc6ef-2d26-4806-9387-386aad501799 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:41.170421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:41.211467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdc6ef-2d26-4806-9387-386aad501799 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:41.244245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:41.244844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:41.245114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:41.245409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:41.255660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:27:41.260314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:41.261670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:27:41.262869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 599/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:41.267675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:41.302264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:41.364870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beaa6f-8382-4f32-8a44-ae3a580b9669 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:41.397672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:41.398265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:41.398541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:41.398818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:41.399470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:41.399769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:41.401123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:41.409610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 590/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:41.415415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:41.511490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8ed55-e670-4d05-b449-4aa3cc399bd6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:41.528303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:41.544748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:41.545403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:41.545736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:41.546013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] PATH_INFO: `/v3/users/173b8b26bf91482795046082d40228f0` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:41.547127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] RBAC: Authorizing `identity:get_user(user_id=173b8b26bf91482795046082d40228f0)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:41.548577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:41.550241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 600/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:41 2022] GET /identity/v3/users/173b8b26bf91482795046082d40228f0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:41.556001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:41.650927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:41.655427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16421c-d759-4c96-87ac-bdf80a6c41e9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:41.687651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836511c1-8a1f-4f27-ad1c-b4615202ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:41.688260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836511c1-8a1f-4f27-ad1c-b4615202ede2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:41.688533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836511c1-8a1f-4f27-ad1c-b4615202ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:41.688797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836511c1-8a1f-4f27-ad1c-b4615202ede2 None admin] PATH_INFO: `/v3/projects/fd7359657ed74c64b4dfc052f30b8112` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:41.689908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836511c1-8a1f-4f27-ad1c-b4615202ede2 None admin] RBAC: Authorizing `identity:get_project(project_id=fd7359657ed74c64b4dfc052f30b8112)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:41.691324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836511c1-8a1f-4f27-ad1c-b4615202ede2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:41.692922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 591/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:41 2022] GET /identity/v3/projects/fd7359657ed74c64b4dfc052f30b8112 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:41.699435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:41.794139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49bf9-64c1-4983-bdb3-dadeef71685b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:41.828212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66665-0617-48a2-bbe7-738b46a18032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:41.828844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66665-0617-48a2-bbe7-738b46a18032 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:41.829118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66665-0617-48a2-bbe7-738b46a18032 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:41.829421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66665-0617-48a2-bbe7-738b46a18032 None admin] PATH_INFO: `/v3/projects/fd7359657ed74c64b4dfc052f30b8112/users/173b8b26bf91482795046082d40228f0/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:41.831294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66665-0617-48a2-bbe7-738b46a18032 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd7359657ed74c64b4dfc052f30b8112, user_id=173b8b26bf91482795046082d40228f0, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:41.832710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66665-0617-48a2-bbe7-738b46a18032 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:41.910121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 601/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:27:41 2022] PUT /identity/v3/projects/fd7359657ed74c64b4dfc052f30b8112/users/173b8b26bf91482795046082d40228f0/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:27:44.073816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1e983-6c8c-4d5b-9e37-41c749e9fd70 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:44.074508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1e983-6c8c-4d5b-9e37-41c749e9fd70 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:44.074508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1e983-6c8c-4d5b-9e37-41c749e9fd70 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:44.075666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 592/1193] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:27:44.080944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:44.081367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:44.081519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:44.100100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:44.101314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:44.142246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:44.165843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 602/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:27:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:27:44.434857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1e983-6c8c-4d5b-9e37-41c749e9fd70 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:44.532778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1e983-6c8c-4d5b-9e37-41c749e9fd70 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:44.564665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:44.565288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:44.565563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:44.565827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:44.577081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:27:44.581869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:27:44.583131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:27:44.584370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 593/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:27:44.589400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:44.683951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356442c5-c5ed-42c1-af34-29de65631a5a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:44.717000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:44.717608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:44.717880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:44.718142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:44.718780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:44.719068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:44.720423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:44.728021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 603/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:44.734199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:44.761880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:44.831987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf137f66-53c2-48b4-8764-e2e81621418a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:44.864260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:44.864865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:44.865134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:44.865424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] PATH_INFO: `/v3/users/173b8b26bf91482795046082d40228f0` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:44.866510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] RBAC: Authorizing `identity:get_user(user_id=173b8b26bf91482795046082d40228f0)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:44.867910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:44.869470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 594/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Fri Sep 9 11:27:44 2022] GET /identity/v3/users/173b8b26bf91482795046082d40228f0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:44.875459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:44.914421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:44.972106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda173-0061-4d07-bd84-81a1be3417c3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:45.005170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:45.005780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:45.006048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:45.006310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:45.071051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:45.072465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:45.108790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:45.166515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 604/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:27:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:27:45.173012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:45.266203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:45.272514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d14df2-3138-466e-96e0-6a71448ecd59 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:45.306813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6627-d4bd-410a-bbc3-813e8a7e0d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:45.307570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6627-d4bd-410a-bbc3-813e8a7e0d2a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:45.308033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6627-d4bd-410a-bbc3-813e8a7e0d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:45.308485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6627-d4bd-410a-bbc3-813e8a7e0d2a None admin] PATH_INFO: `/v3/projects/fd7359657ed74c64b4dfc052f30b8112` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:45.310300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6627-d4bd-410a-bbc3-813e8a7e0d2a None admin] RBAC: Authorizing `identity:get_project(project_id=fd7359657ed74c64b4dfc052f30b8112)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:45.312803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6627-d4bd-410a-bbc3-813e8a7e0d2a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:45.315674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 595/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Fri Sep 9 11:27:45 2022] GET /identity/v3/projects/fd7359657ed74c64b4dfc052f30b8112 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:45.321795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:45.418316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488e20-69d2-44e3-b01d-b35734a12dc4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:45.451013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:45.451590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:45.451864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:45.452131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:45.452829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=fd7359657ed74c64b4dfc052f30b8112, user.id=173b8b26bf91482795046082d40228f0) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:27:45.453130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:45.454583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b90c1-e458-4a33-bd4c-04722d2c56a0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:45.460112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 605/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:27:45 2022] GET /identity/v3/role_assignments?user.id=173b8b26bf91482795046082d40228f0&scope.project.id=fd7359657ed74c64b4dfc052f30b8112&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:27:55.304954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=19 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:55.457645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:02.272204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f832b-486f-4f93-8d72-06f1c95128de None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:02.272811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f832b-486f-4f93-8d72-06f1c95128de None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:02.272811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f832b-486f-4f93-8d72-06f1c95128de None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:02.274157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 596/1201] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:02.279343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:02.279757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:02.279892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:02.299608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:02.300769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:02.367082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 606/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:02.634265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f832b-486f-4f93-8d72-06f1c95128de None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:02.734037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f832b-486f-4f93-8d72-06f1c95128de None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:02.765668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:02.766277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:02.766550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:02.766814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:02.777438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:02.778875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:02.793206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:02.794462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:02.795660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:02.795660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:02.795660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:02.795660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 597/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:02.800398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:02.894895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80c5fd-ae09-42ab-b1bf-c06ebf05c31d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:02.922792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:02.928350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:02.928943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:02.929235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:02.929509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:02.930133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:02.930425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:02.931784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0526-6e40-4aa6-986d-b9781273f436 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:02.942867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 607/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:02.948670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:03.001401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:03.051225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b8e62-6b67-4246-b395-bd274e7d7883 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:03.093578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ddfdf-9a09-4d71-82e3-63027356c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:03.094181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ddfdf-9a09-4d71-82e3-63027356c4b6 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:03.094459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ddfdf-9a09-4d71-82e3-63027356c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:03.094752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ddfdf-9a09-4d71-82e3-63027356c4b6 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:03.095397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ddfdf-9a09-4d71-82e3-63027356c4b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:03.096824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ddfdf-9a09-4d71-82e3-63027356c4b6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:03.198748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 598/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Fri Sep 9 11:29:02 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:29:05.371586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa4422-7ceb-4ede-9885-19e6b5d63657 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:05.372164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa4422-7ceb-4ede-9885-19e6b5d63657 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:05.372164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa4422-7ceb-4ede-9885-19e6b5d63657 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:05.373473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 608/1206] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:05.378576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:05.379008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:05.379108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:05.397237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:05.398426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:05.474914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 599/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:05.750559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa4422-7ceb-4ede-9885-19e6b5d63657 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:05.856646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa4422-7ceb-4ede-9885-19e6b5d63657 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:05.888716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:05.889275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:05.889550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:05.889812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:05.899903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:29:05.905081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:05.911130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:05.912016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 609/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:29:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:05.912748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:05.951038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:06.008152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc23cb-4b6f-4fec-9e2c-1e3e31065b55 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:06.041575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:06.042168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:06.042441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:06.042707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:06.043350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:06.043645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:06.044985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:06.052469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 600/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:29:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:06.058433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:06.109433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:06.161692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fe58-85c7-471c-87c8-a7c7ef04fa53 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:06.199426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:06.200037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:06.200308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:06.200573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:06.210843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:06.212261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:06.226729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:06.227877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:06.229178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:06.229178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:06.229178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:06.229178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 610/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:06.233708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:06.329338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:06.332317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460a23-4801-4de7-afa1-cb775f4b32a6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:06.365751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:06.366351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:06.366629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:06.366899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:06.367532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:06.367829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:06.369779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:06.381108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 601/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:06.387416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:06.495036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57322e1-97f0-49c4-9793-2bf944458add None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:06.496569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:06.528658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:06.529296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:06.529574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:06.529841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:06.537965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:06.539383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:29:06.550330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:06.551651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:06.552946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 611/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:06.557958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:06.658985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54291eb-5f13-48c7-b73d-15c1bb063e09 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:06.692039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:06.692615 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:06.692888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:06.693151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:06.693889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:06.694185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:06.695588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:06.713099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 602/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Sep 9 11:29:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:06.719037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:06.818462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c70dd-991e-4f4f-8e13-7ec234cf6937 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:06.851288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:06.851877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:06.852161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:06.852416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:06.882509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:06.919677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:06.921114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:07.018107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 612/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:29:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:29:07.024009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:07.043087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:07.123337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c19627-6a47-48aa-b69b-3c1e5c76c1a0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:07.156798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:07.157442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:07.157718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:07.157984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:07.168135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:07.169650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:07.183697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:07.184826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:07.185962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:07.185962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:07.185962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:07.185962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 603/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:07.190635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:07.250993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:07.289028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053586a-066b-4e65-9609-4e9bef17a9d1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:07.321953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:07.322755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:07.323031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:07.323298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:07.323916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:07.324210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:07.325584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:07.336417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 613/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:07.343065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:07.411262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:07.442296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dfbd0-45eb-4975-ae00-0f64b0ec0aeb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:07.475280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:07.475889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:07.476165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:07.476430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:07.483487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:07.484911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:29:07.495871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:07.507809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:07.508968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 604/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:07.510308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:07.602267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001da7a-6ec8-4f8a-a207-cbda80109871 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:07.624218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:07.636244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:07.636830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:07.637102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:07.637401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:07.638071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:07.638366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:07.639780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a2e75-952c-4ac2-9d31-f6ef5ce78688 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:07.652078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 614/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:07.658103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:07.757373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300fb9-26e7-4c94-9397-fbdbb34afd6d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:07.785304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:07.791049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:07.791638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:07.791913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:07.792179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:07.792887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=98c4b86c13494f3fb1ff2957a2cbdf45) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:07.793194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:07.794642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7778e-eb80-41af-b77a-9d3b8ecc49ff None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:07.799748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 605/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:29:07 2022] GET /identity/v3/role_assignments?user.id=98c4b86c13494f3fb1ff2957a2cbdf45&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:09.929627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5e7d-0347-4db0-950f-4d9d5d034200 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:09.930164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5e7d-0347-4db0-950f-4d9d5d034200 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:09.930164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5e7d-0347-4db0-950f-4d9d5d034200 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:09.932111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 615/1220] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:09.939230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:09.939748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:09.940024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:09.958698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:09.959875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:10.024512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 606/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:10.300055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5e7d-0347-4db0-950f-4d9d5d034200 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:10.402441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5e7d-0347-4db0-950f-4d9d5d034200 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:10.436537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:10.437151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:10.437473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:10.437743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:10.447537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:29:10.452310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:10.456426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:10.457401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 616/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:10.459573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:10.556578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2bdaa-7805-4d84-93dd-999f72fbfd00 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:10.579897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:10.590965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:10.591563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:10.591845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:10.592128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:10.592765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:10.593063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:10.594453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:10.602426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 607/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:10.608291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:10.653893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:10.710922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba93dff-b7d3-477f-8ed5-846378d083b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:10.744472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:10.745080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:10.745385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:10.745650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:10.755765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:10.757185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:10.771312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:10.772296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:10.773587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:10.773587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:10.773587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:10.773587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 617/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:10.779243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:10.879042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996052-c8fb-4de3-8e82-fc69256eddd9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:10.912296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:10.912888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:10.913159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:10.913457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:10.914081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:10.914374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:10.916014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:10.927704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 608/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:10.934235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.026454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:11.032863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ca16-ee2a-4c58-a2a5-c9a85f8c4a22 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:11.065138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:11.065777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:11.066052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:11.066324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:11.074213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:11.075634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:29:11.086493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:11.087712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:11.088882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 618/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:11.093732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.140807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:11.192076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae02c-1403-4c93-afa9-c0fdc1000420 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:11.227471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:11.228589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:11.228896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:11.229205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:11.229932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:11.230269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:11.231666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:11.248869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 609/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Sep 9 11:29:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:11.254912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.354292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102572c6-30ef-4cf1-abf3-601eb8dd0a60 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:11.387702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:11.388311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:11.388586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:11.388854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:11.399838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:11.402221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:11.416367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:11.417621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:11.418811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:11.418811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:11.418811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:11.418811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 619/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:11.423449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.523883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dbff3-c6e4-444f-9195-6e3e106a4fde None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:11.526780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:11.558796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:11.559389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:11.559669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:11.559919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:11.560587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:11.560877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:11.562244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:11.573670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 610/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:11.579438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.589115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:11.679591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2421b0-0f12-4386-8e2a-98bfa0ac09b3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:11.713905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:11.716133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:11.716133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:11.716133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:11.721585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:11.723401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:29:11.735576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:11.736629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:11.737780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 620/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:11.742614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.842905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511b28-75d8-40b6-b4f8-54ee03be1ab1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:11.876019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:11.876619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:11.876897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:11.877166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:11.877891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:11.878194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:11.879614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95648595-82ca-4961-91bf-8cc34dfd18dd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:11.891981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 611/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:29:11.898194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:11.962542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:11.997280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd34d70-4614-4b43-95a8-8bdb9db8c249 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:12.029436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf699-155c-44c4-9216-4405fff794ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:12.030073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf699-155c-44c4-9216-4405fff794ff None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:12.030352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf699-155c-44c4-9216-4405fff794ff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:12.030620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf699-155c-44c4-9216-4405fff794ff None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/98c4b86c13494f3fb1ff2957a2cbdf45/roles/99c1c76eebf142cebe66548c06f88e6b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:12.044840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccf699-155c-44c4-9216-4405fff794ff None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=98c4b86c13494f3fb1ff2957a2cbdf45, role_id=99c1c76eebf142cebe66548c06f88e6b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:12.046318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccf699-155c-44c4-9216-4405fff794ff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:12.151742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 621/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:29:11 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/98c4b86c13494f3fb1ff2957a2cbdf45/roles/99c1c76eebf142cebe66548c06f88e6b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:29:14.296115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f663-4562-4005-b30f-6c804421566c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:14.296667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f663-4562-4005-b30f-6c804421566c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:14.296667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f663-4562-4005-b30f-6c804421566c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:14.298021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 612/1233] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:14.303249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:14.303668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:14.303773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:14.321773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:14.326068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:14.388767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 622/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:14.652928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9f663-4562-4005-b30f-6c804421566c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:14.678252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:14.756111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9f663-4562-4005-b30f-6c804421566c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:14.789522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:14.790130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:14.790402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:14.790665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:14.800897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:29:14.805660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:14.806772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:14.807641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 613/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Fri Sep 9 11:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:14.813567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:14.858891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:14.915626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc8b92-0b5c-4f02-8f3c-9bd5ba8c5dc9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:14.948950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:14.949595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:14.949870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:14.950134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:14.951648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:14.951940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:14.953333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:14.961644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 623/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Fri Sep 9 11:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:14.967583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:15.051735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:15.068023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649430c9-bec4-451e-b44a-4cba5f8a672c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:15.101149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:15.101812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:15.102088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:15.102353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:15.112786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:15.114317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:15.129445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:15.130794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:15.131837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:15.131837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:15.131837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:15.131837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 614/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:15.136434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:15.237868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615959b-a483-4a97-a0aa-ed77160439ef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:15.246405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:15.271101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:15.271692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:15.271970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:15.272237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:15.272856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:15.273149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:15.274545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:15.286007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 624/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:15.291751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:15.393896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cefd-5735-408b-8f98-edad3985fd39 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:15.427651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:15.428268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:15.428545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:15.428813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:15.431413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:15.437445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:15.438878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:29:15.449681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:15.451223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:15.452709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 615/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:15.456842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:15.558873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc48dd-aa64-45f0-89b6-76ac4ff6351f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:15.593064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:15.593682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:15.593959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:15.594227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:15.594933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:15.595231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:15.596656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:15.614057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 625/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Sep 9 11:29:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:15.619809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:15.718583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f14e7-a585-4096-b4d0-b00254386398 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:15.751635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:15.752229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:15.752505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:15.752777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:15.812814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:15.819015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:15.820445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:15.917657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 616/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:29:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:29:15.923904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:15.949960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:16.020536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192045cd-1068-4250-b866-1e6fe867ffe9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:16.055547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:16.064804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:16.064804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:16.064804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:16.068445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:16.070131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:16.085375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:16.086603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:16.087886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:16.087886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:16.087886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:16.087886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 626/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:16.092839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:16.184373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:16.190622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84c75-0d1c-4598-94f5-a1271caaa26a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:16.224063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:16.224679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:16.224957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:16.225235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:16.225888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:16.226189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:16.227800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:16.240215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 617/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:16.249270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:16.328401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:16.349829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae585b2c-5644-4a01-a2a8-9cc24ba48bc1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:16.382213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:16.382817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:16.383088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:16.383353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:16.390328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:16.391791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:29:16.402551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:16.403615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:16.405201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 627/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:16.410215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:16.508441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c074b-b576-4362-a999-e629d06c7362 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:16.542396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:16.542992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:16.543271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:16.543542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:16.544227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:16.544522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:16.546022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992be34-3a05-4690-850c-bed3e0c84de1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:16.557745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 618/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:16.564122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:16.664866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0d439-94cc-4546-96ca-432943bb05c4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:16.697631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:16.698222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:16.698500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:16.698763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:16.699465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] RBAC: Adding query filter params (role.id=99c1c76eebf142cebe66548c06f88e6b, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=98c4b86c13494f3fb1ff2957a2cbdf45) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:16.699767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:16.701230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba719e3-877f-4b7d-9be0-8e0fded777f3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:16.707618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 628/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:29:16 2022] GET /identity/v3/role_assignments?user.id=98c4b86c13494f3fb1ff2957a2cbdf45&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=99c1c76eebf142cebe66548c06f88e6b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:18.889542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4428bd-ff87-44b4-a714-9aa6bca45b7a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:18.890059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4428bd-ff87-44b4-a714-9aa6bca45b7a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:18.890059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4428bd-ff87-44b4-a714-9aa6bca45b7a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:18.891421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 619/1247] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:18.896453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:18.896855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:18.896996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:18.903554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:18.915430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:18.918160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:18.983115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 629/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:19.248348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4428bd-ff87-44b4-a714-9aa6bca45b7a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:19.267472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:19.349573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4428bd-ff87-44b4-a714-9aa6bca45b7a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:19.386138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253de85-979a-412d-b934-987daa3833bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:19.386804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253de85-979a-412d-b934-987daa3833bc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:19.387083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253de85-979a-412d-b934-987daa3833bc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:19.387353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253de85-979a-412d-b934-987daa3833bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:19.397903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253de85-979a-412d-b934-987daa3833bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-1253de85-979a-412d-b934-987daa3833bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:29:19.402660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:19.403819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:19.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 620/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:19.410235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:19.509267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5219c2d-e6ff-400d-a9ed-b9ddcb46fe56 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:19.537959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:19.542704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:19.543298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:19.543571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:19.543839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:19.544492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:19.544788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:19.546197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:19.554898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 630/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:19.560879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253de85-979a-412d-b934-987daa3833bc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:19.639384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:19.662352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253de85-979a-412d-b934-987daa3833bc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:19.695685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:19.696425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:19.696635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:19.696910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:19.707142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:19.708573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:19.722414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:19.723621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:19.724618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:19.724618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:19.724618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:19.724618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 621/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:19.729525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:19.827842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05fd71-54e8-44fa-98e7-5e7f5b746257 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:19.860437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:19.862680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:19.862680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:19.862680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:19.862680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:19.863036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:19.864322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:19.875841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 631/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:19.881844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:19.980157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50672d-1098-46ff-895d-2aeb0591d8eb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:20.007151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:20.014670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:20.015279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:20.015549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:20.015813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:20.023134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:20.024547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:29:20.035816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:20.036965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:20.038180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 622/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:20.042669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:20.097124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:20.140639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356f9c0-5929-4baa-b81c-b55172d15725 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:20.175875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:20.176468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:20.176742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:20.184198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:20.184929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:20.185254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:20.186685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:20.208913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 632/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Sep 9 11:29:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:20.214933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:20.316701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c0367-1f91-4b85-af4f-19098a8e912a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:20.350470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:20.351000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:20.351278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:20.351540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:20.405164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:20.417801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:20.419233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:20.516533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 623/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:29:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:29:20.523511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:20.622035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879159ea-fb1f-42b4-bda4-665613c02fdf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:20.635453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:20.656669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:20.657362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:20.657635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:20.657910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:20.667909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:20.669380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:20.683575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:20.684770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:20.686090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:20.686090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:20.686090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:20.686090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 633/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:20.691029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:20.778050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:20.789510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45109dc-ab3d-43c3-9145-192cf6fa32cc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:20.826960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:20.827561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:20.827844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:20.828111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:20.828742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:20.829039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:20.830423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:20.842848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 624/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:20.849035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:20.949631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f99367-6b6b-4aca-a663-c8d125405109 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:20.982497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:20.983102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:20.983374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:20.983640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:20.990552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:20.991989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:29:21.003346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:21.004657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:21.005813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 634/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:21.010590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:21.108847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab75b3-5407-450d-8336-9a00bf2a030c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:21.141852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:21.142435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:21.142708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:21.142973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:21.144360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:21.144666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:21.146100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c961e0-ff82-49a1-b327-85e48ad9f08a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:21.157526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 625/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:21.164360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:21.189312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:21.263801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ba5e-de11-4a27-acb7-4cf1cf38b861 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:21.296485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:21.297066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:21.297365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:21.297630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:21.298324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=98c4b86c13494f3fb1ff2957a2cbdf45) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:21.298619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:21.300143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a834b-9eee-47ac-b548-5abe00f3f245 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:21.305278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 635/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:29:21 2022] GET /identity/v3/role_assignments?user.id=98c4b86c13494f3fb1ff2957a2cbdf45&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=137cd8e0839747668eef67677a0171b5 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:23.417012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5ad0-2fcc-4ba4-b9f3-a6f9b9c75abd None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:23.417585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5ad0-2fcc-4ba4-b9f3-a6f9b9c75abd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:23.417585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5ad0-2fcc-4ba4-b9f3-a6f9b9c75abd None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:23.418900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 626/1261] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:23.423885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:23.424263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:23.424452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:23.442503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:23.443739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:23.508522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 636/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:23.775868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5ad0-2fcc-4ba4-b9f3-a6f9b9c75abd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:23.786869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:23.875112 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5ad0-2fcc-4ba4-b9f3-a6f9b9c75abd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:23.908787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:23.909437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:23.909720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:23.909990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:23.921372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:29:23.934896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:23.935885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:23.936767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 627/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:29:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:23.937558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:23.951893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:24.033319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2cd1-5336-449e-a60f-9d559fed6168 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:24.068691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:24.069726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:24.070231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:24.070721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:24.071943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:24.072473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:24.074765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:24.082744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 637/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:29:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:24.088655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:24.154914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:24.186864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0435bf-bf08-4079-bc83-8d08c6965c00 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:24.218603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:24.219212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:24.219485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:24.219756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:24.230035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:24.231515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:24.249860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:24.253698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:24.254853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:24.254853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:24.254853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:24.254853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 628/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:24.257703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:24.343650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:24.362720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d9fb-0123-40b3-aa4e-3c2817ccb02b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:24.395632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:24.396243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:24.396522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:24.396793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:24.397442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:24.397738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:24.399256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:24.410476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 638/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:24.416859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:24.514819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f19fe-e544-470b-a43d-731ad9cb1c08 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:24.533780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:24.547982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:24.548594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:24.548877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:24.549146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] PATH_INFO: `/v3/users/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:24.558142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:24.559579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:29:24.574671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:24.575890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:24.577043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 629/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:24.582611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:24.682940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f502-3b63-4dfe-b719-19a9765d73d7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:24.717026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:24.717588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:24.717864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:24.718127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:24.718831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:24.719126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:24.720536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:24.730074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:24.738558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 639/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Sep 9 11:29:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:24.745154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:24.843994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2593-8824-431a-ae78-0ecc59dceaae None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:24.876584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:24.877132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:24.877432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:24.877700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:24.888168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:24.893643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:24.903841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:24.904970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:24.906186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:24.906186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:24.906186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:24.906186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 630/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:24.910926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:25.010693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace4f6-2f49-49e0-8614-34738303b7b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:25.044397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:25.044987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:25.045282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:25.045547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:25.046163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:25.046452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:25.047892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:25.058940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 640/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:25.064631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:25.096090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:25.163779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad83b35-aef9-4562-96df-7fdcbd5bc28b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:25.196875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:25.197521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:25.197796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:25.198062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:25.204798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:25.206247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:29:25.217977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:25.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:25.224811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 631/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:25.225455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:25.281835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:25.321949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2319b-a80d-424d-9e1f-4468e54d2755 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:25.354068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:25.354667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:25.354921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:25.355211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:25.355879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:25.356173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:25.357604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80070-97ed-4f2d-91c1-27bf256ee8f2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:25.369376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 641/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:25.375972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:25.468468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:25.476940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383a16-90cd-4d6c-9170-18bad2a28eea None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:25.510504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0cf11-cba5-4fbc-9024-ddec87876b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:25.511147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0cf11-cba5-4fbc-9024-ddec87876b91 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:25.511420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0cf11-cba5-4fbc-9024-ddec87876b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:25.511745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0cf11-cba5-4fbc-9024-ddec87876b91 None admin] PATH_INFO: `/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/98c4b86c13494f3fb1ff2957a2cbdf45/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:25.513669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0cf11-cba5-4fbc-9024-ddec87876b91 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c877ca414404c64b20ba9b6cbdd1aae, user_id=98c4b86c13494f3fb1ff2957a2cbdf45, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:25.515089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0cf11-cba5-4fbc-9024-ddec87876b91 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:25.724480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 632/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Fri Sep 9 11:29:25 2022] PUT /identity/v3/projects/9c877ca414404c64b20ba9b6cbdd1aae/users/98c4b86c13494f3fb1ff2957a2cbdf45/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:29:27.869123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00d1aa-f5ed-45f5-bfc4-cdb7b6ad6e16 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:27.869704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00d1aa-f5ed-45f5-bfc4-cdb7b6ad6e16 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:27.869704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00d1aa-f5ed-45f5-bfc4-cdb7b6ad6e16 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:27.871039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 642/1274] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:27.879926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:27.879926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:27.879926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:27.895525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:27.896693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:27.976668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 633/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:28.248511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00d1aa-f5ed-45f5-bfc4-cdb7b6ad6e16 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:28.358635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00d1aa-f5ed-45f5-bfc4-cdb7b6ad6e16 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:28.375515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:28.392122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:28.392747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:28.395342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:28.395342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:28.404326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:29:28.409833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:28.411013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:28.412295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 643/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Fri Sep 9 11:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:28.417241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:28.498955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:28.517196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bc55b-dc9c-4e24-9c08-9f6550aa81eb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:28.550377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:28.550983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:28.551321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:28.551796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:28.552867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:28.553239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:28.554596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:28.563370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 634/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Fri Sep 9 11:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:28.569153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:28.670312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a7ac-07b8-4249-99cc-b450db792bf9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:28.704350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:28.704964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:28.705260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:28.705532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:28.715517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:28.716960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:28.732076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:28.733309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:28.734310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:28.734310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:28.734310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:28.734310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 644/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:28.739610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:28.850707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296c53-0fb4-47ac-a26c-f4e0576d5f10 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:28.895001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:28.896065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:28.896357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:28.896633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:28.897513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:28.898073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:28.899857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:28.914778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 635/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:28.921126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:28.953181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:29.043492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9422d40-42f3-4ae9-9588-186d6c8e8129 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:29.080312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:29.081495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:29.081495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:29.081495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:29.089590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:29.091046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:29:29.102469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:29.104174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:29.106557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 645/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:29.111069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:29.115134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:29.222764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaaafc-7533-4c95-aaf9-050966764389 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:29.260886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:29.261512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:29.261786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:29.262049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:29.262768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:29.263063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:29.264600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:29.283214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 636/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Fri Sep 9 11:29:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:29.292493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:29.393421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:29.407553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbb57c-ca8d-4d52-a58d-2856c0ec51ef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:29.445838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:29.446779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:29.447275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:29.447813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:29.525502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:29.527580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:29.620431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:29.631198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 646/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Fri Sep 9 11:29:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:29:29.637152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:29.697361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:29.734924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed92c3-f6e9-47fc-9198-ac0bfe9c9544 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:29.769003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604604-c035-454d-98da-92d61095a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:29.769670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604604-c035-454d-98da-92d61095a462 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:29.769947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604604-c035-454d-98da-92d61095a462 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:29.770213 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604604-c035-454d-98da-92d61095a462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:29.780843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604604-c035-454d-98da-92d61095a462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:29.782320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604604-c035-454d-98da-92d61095a462 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6a604604-c035-454d-98da-92d61095a462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:29:29.796803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:29.798735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:29:29.799904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:29:29.799904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:29:29.799904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:29.799904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 637/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:29.803761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:29.902831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ad1bf-150f-423b-bfcd-8586c0c708b7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:29.936228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:29.936817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:29.937079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:29.937380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:29.938001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:29.938297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:29.939753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:29.952393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 647/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Fri Sep 9 11:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:29.958074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604604-c035-454d-98da-92d61095a462 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:30.056607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604604-c035-454d-98da-92d61095a462 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:30.070250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:30.090156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:30.090771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:30.091052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:30.091320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:30.097763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:30.099191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:29:30.111248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:30.112445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: ERROR keystone.server.flask.application Sep 09 11:29:30.113691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 638/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Fri Sep 9 11:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:30.118574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:30.167961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:30.218196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36994f-0bad-410b-89b3-e6b8dd657c25 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:30.251251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:30.251874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:30.252145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:30.252408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:30.253150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:30.253473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:30.254897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753ee64-5c83-419b-be26-05157f57e57f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:30.267168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 648/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Fri Sep 9 11:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:30.273385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:30.379504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846938-8e24-41a5-9d81-23e47c2690be None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:30.412070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:30.412660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:30.412935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:30.413199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:30.413988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] RBAC: Adding query filter params (role.id=137cd8e0839747668eef67677a0171b5, scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae, user.id=98c4b86c13494f3fb1ff2957a2cbdf45) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:30.414289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:30.415705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78774-c926-49bd-9684-30a895c1b021 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:30.422284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 639/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Fri Sep 9 11:29:30 2022] GET /identity/v3/role_assignments?user.id=98c4b86c13494f3fb1ff2957a2cbdf45&scope.project.id=9c877ca414404c64b20ba9b6cbdd1aae&role.id=137cd8e0839747668eef67677a0171b5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:32.584568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb225323-766a-460f-ba3f-4d51b74f6cc8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:32.585130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb225323-766a-460f-ba3f-4d51b74f6cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:32.585130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb225323-766a-460f-ba3f-4d51b74f6cc8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:32.586467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 649/1288] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:32.592398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:32.592797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:32.592946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:32.611177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:32.618450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:32.642310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:32.679046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 640/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:32.950465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb225323-766a-460f-ba3f-4d51b74f6cc8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:33.050955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb225323-766a-460f-ba3f-4d51b74f6cc8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:33.062065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:33.084763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e195f5-315e-448b-9974-243167850956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:33.085406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e195f5-315e-448b-9974-243167850956 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:33.085682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e195f5-315e-448b-9974-243167850956 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:33.085949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e195f5-315e-448b-9974-243167850956 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:33.086513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e195f5-315e-448b-9974-243167850956 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:33.087860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e195f5-315e-448b-9974-243167850956 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-99e195f5-315e-448b-9974-243167850956 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:33.096714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:33.098068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:33.099159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 650/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:29:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:33.103866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:33.200170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1968f-615e-4f8b-9f33-3a6a2a0c6c47 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:33.234307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:33.234836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:33.235109 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:33.235371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:33.235977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:33.236268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:33.237646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcf726-a0e6-43eb-91ff-8b70327f8a04 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:33.242338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 641/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Sep 9 11:29:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:33.248979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e195f5-315e-448b-9974-243167850956 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:33.347378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e195f5-315e-448b-9974-243167850956 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:33.380865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:33.381477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:33.381771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:33.382013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:33.382623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:33.382915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:33.384269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ebaf-c09b-4b8e-a882-01d43451179b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:33.388675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 651/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Sep 9 11:29:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:35.540768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab3bec-2cc1-4ab5-9187-1a26fb98d460 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:35.541349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab3bec-2cc1-4ab5-9187-1a26fb98d460 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:35.541349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab3bec-2cc1-4ab5-9187-1a26fb98d460 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:35.542655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 642/1293] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:35.548101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf0a2-06a7-4995-97d7-5684971edd0f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:35.548491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf0a2-06a7-4995-97d7-5684971edd0f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:35.548645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf0a2-06a7-4995-97d7-5684971edd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:35.567047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f70cf0a2-06a7-4995-97d7-5684971edd0f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:35.568229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f70cf0a2-06a7-4995-97d7-5684971edd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:35.597781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:35.645652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 652/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:35.918809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab3bec-2cc1-4ab5-9187-1a26fb98d460 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:35.955450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:36.029108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab3bec-2cc1-4ab5-9187-1a26fb98d460 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:36.063603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c9579-4069-473e-8438-254c7caf1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:36.064772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9579-4069-473e-8438-254c7caf1134 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:36.064772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9579-4069-473e-8438-254c7caf1134 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:36.064772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9579-4069-473e-8438-254c7caf1134 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:36.065439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c9579-4069-473e-8438-254c7caf1134 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:36.066783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c9579-4069-473e-8438-254c7caf1134 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:36.214911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 643/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Fri Sep 9 11:29:35 2022] POST /identity/v3/services => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:29:38.390752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d277a9-7c25-4c0d-bf4b-1f2ba16ee2af None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:38.391287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d277a9-7c25-4c0d-bf4b-1f2ba16ee2af None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:38.391287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d277a9-7c25-4c0d-bf4b-1f2ba16ee2af None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:38.392710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 653/1296] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:38.398077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:38.398484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:38.398634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:38.417288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:38.418481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:38.492451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 644/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:29:38.761322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d277a9-7c25-4c0d-bf4b-1f2ba16ee2af None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:38.859740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d277a9-7c25-4c0d-bf4b-1f2ba16ee2af None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:38.892338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:38.893490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:38.893848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:38.894024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:38.894585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:38.896017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:38.904513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:38.905776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:38.906861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 654/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:29:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:38.912379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:38.930378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:39.009811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df81722-8cfb-45e5-825f-cda743aa9f0b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:39.043556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:39.044084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:39.044358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:39.044620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:39.045255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:39.045551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:39.046896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:39.051851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 645/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Sep 9 11:29:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:39.057868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:39.090018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:39.157062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6844f-a9b6-4f98-9943-bca019ac4c62 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:39.191015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:39.191643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:39.191963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:39.192273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:39.193034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] RBAC: Adding query filter params (interface=public, service_id=0c6122d52fb9466980b301409faf385c, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:39.193389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:39.194807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa3212-9d47-4124-860a-4ea21db7177b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:39.199816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 655/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Fri Sep 9 11:29:39 2022] GET /identity/v3/endpoints?service_id=0c6122d52fb9466980b301409faf385c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:39.205576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:39.286841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:39.304903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf283-0681-40c9-ac96-8b24dbe9adcc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:39.339661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3b9b7-0193-4b0e-ab0a-d83185bee25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:39.340257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3b9b7-0193-4b0e-ab0a-d83185bee25c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:39.340532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3b9b7-0193-4b0e-ab0a-d83185bee25c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:39.340798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3b9b7-0193-4b0e-ab0a-d83185bee25c None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:39.341424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3b9b7-0193-4b0e-ab0a-d83185bee25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:39.342776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3b9b7-0193-4b0e-ab0a-d83185bee25c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:39.349528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 646/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Fri Sep 9 11:29:39 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:29:41.518676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a7951-928e-4ef8-b36a-e48cc657b9ad None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:41.519242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a7951-928e-4ef8-b36a-e48cc657b9ad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:41.519242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a7951-928e-4ef8-b36a-e48cc657b9ad None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:41.520693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 656/1302] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:41.525952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:41.526374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:41.526599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:41.546444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:41.547668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:41.617577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 647/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:29:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:29:41.888833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a7951-928e-4ef8-b36a-e48cc657b9ad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:41.983904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:41.990657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a7951-928e-4ef8-b36a-e48cc657b9ad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:42.024191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:42.024805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:42.025083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:42.025387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:42.025956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:42.027307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:29:42.035814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:29:42.037369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Sep 09 11:29:42.038407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 657/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Fri Sep 9 11:29:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:29:42.043017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:42.116885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:42.139544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12afb2-3be1-4448-bf9c-6e78e8e49114 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:42.171912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:42.172519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:42.172775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:42.173038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:42.173675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:29:42.173971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:42.175322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72187582-5233-4c7f-8cc6-796de2ec3de5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:42.180388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 648/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Fri Sep 9 11:29:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:29:42.186204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:42.284048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b54d-3c4d-447d-9027-d9573d0ae244 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:42.317009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f74fe9-5788-4e49-88bf-c62bb2c06ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:42.318166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74fe9-5788-4e49-88bf-c62bb2c06ffa None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:42.318434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74fe9-5788-4e49-88bf-c62bb2c06ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:42.318696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74fe9-5788-4e49-88bf-c62bb2c06ffa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:42.319339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f74fe9-5788-4e49-88bf-c62bb2c06ffa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:42.320800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f74fe9-5788-4e49-88bf-c62bb2c06ffa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:42.396178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 658/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:29:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:29:52.190676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=30 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:52.391580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:15.513106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91683-d0ab-466a-ba8a-5e6469f06f56 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:15.513620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91683-d0ab-466a-ba8a-5e6469f06f56 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:15.513727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91683-d0ab-466a-ba8a-5e6469f06f56 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:15.520236 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782b48-9186-4689-b071-f24bb84888ac None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:15.520652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782b48-9186-4689-b071-f24bb84888ac None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:15.520777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782b48-9186-4689-b071-f24bb84888ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:15.526314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 649/1307] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:15.602215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4f782b48-9186-4689-b071-f24bb84888ac None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:15.603853 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4f782b48-9186-4689-b071-f24bb84888ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:15.711367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 659/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:37:16.015983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39441436-7e85-41bf-b6ca-15d9a0429e02 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:16.016271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39441436-7e85-41bf-b6ca-15d9a0429e02 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:16.016541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39441436-7e85-41bf-b6ca-15d9a0429e02 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:16.018040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 650/1309] 10.222.0.64 () {54 vars in 965 bytes} [Fri Sep 9 11:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:16.023926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257b90-b81f-4517-8c15-479034a8cc51 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:16.024211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257b90-b81f-4517-8c15-479034a8cc51 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:16.024518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257b90-b81f-4517-8c15-479034a8cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:16.109196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f8257b90-b81f-4517-8c15-479034a8cc51 None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:16.110426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f8257b90-b81f-4517-8c15-479034a8cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:16.133039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:16.192797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 660/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Fri Sep 9 11:37:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:16.202799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39441436-7e85-41bf-b6ca-15d9a0429e02 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:16.205200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-39441436-7e85-41bf-b6ca-15d9a0429e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:16.341135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39441436-7e85-41bf-b6ca-15d9a0429e02 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:16.427309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:16.428222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:16.428499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:16.428769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:16.430400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:16.492769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:16.553930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:16.555566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50574cc-bd87-4ae4-839e-fbb9f4343e3e service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:16.575026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 651/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:19.044203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f8f3-2334-4ec2-ae97-b41b78382bbd None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:19.044781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f8f3-2334-4ec2-ae97-b41b78382bbd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:19.044781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f8f3-2334-4ec2-ae97-b41b78382bbd None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:19.046269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 661/1312] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:19.051359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50a4f6-491c-4b94-b1fc-e30091addd1f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:19.051786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50a4f6-491c-4b94-b1fc-e30091addd1f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:19.051889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50a4f6-491c-4b94-b1fc-e30091addd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:19.138939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1d50a4f6-491c-4b94-b1fc-e30091addd1f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:19.140155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1d50a4f6-491c-4b94-b1fc-e30091addd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:19.239175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 652/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:19.526319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5f8f3-2334-4ec2-ae97-b41b78382bbd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:19.527925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ce5f8f3-2334-4ec2-ae97-b41b78382bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:19.633375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5f8f3-2334-4ec2-ae97-b41b78382bbd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:19.712094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:19.714506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:19.715183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:19.715458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:19.715725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:19.717395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:19.835778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:19.837601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3a5b1-f4aa-4bf1-9a66-43465bf020d8 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:19.858517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 662/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:22.513948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20513-6270-4ebf-bbcf-3336ee3a23d3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:22.514520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20513-6270-4ebf-bbcf-3336ee3a23d3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:22.514520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20513-6270-4ebf-bbcf-3336ee3a23d3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:22.515845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 653/1315] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:22.521120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bca2-7d12-488a-ad2d-f889a815f756 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:22.521552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bca2-7d12-488a-ad2d-f889a815f756 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:22.521701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bca2-7d12-488a-ad2d-f889a815f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:22.586124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4305bca2-7d12-488a-ad2d-f889a815f756 None None] MFA Rules not processed for user `fa556f2cd54b4d48b2a814a881a5d7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:22.588171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4305bca2-7d12-488a-ad2d-f889a815f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:22.640934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:22.685792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 663/1316] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:22.970955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20513-6270-4ebf-bbcf-3336ee3a23d3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:22.972484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f0f20513-6270-4ebf-bbcf-3336ee3a23d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:22.982734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:23.074039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20513-6270-4ebf-bbcf-3336ee3a23d3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:23.146588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:23.147179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:23.147445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:23.147703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:23.149898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:23.212934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:23.259398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:23.260758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcb886-1361-4f79-82cf-3f3bd3eb8256 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:23.278751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 654/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:26.250241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b50ee-5123-4bfd-9a6a-e7941c7916a6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:26.250787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b50ee-5123-4bfd-9a6a-e7941c7916a6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:26.250787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b50ee-5123-4bfd-9a6a-e7941c7916a6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:26.252109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 664/1318] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:26.257431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7a2e8-2e10-48e6-b411-595e2d38f8a1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:26.257868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7a2e8-2e10-48e6-b411-595e2d38f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:26.257975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7a2e8-2e10-48e6-b411-595e2d38f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:26.323078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-46d7a2e8-2e10-48e6-b411-595e2d38f8a1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:26.324267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-46d7a2e8-2e10-48e6-b411-595e2d38f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:26.418040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 655/1319] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:26.717047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0357e-d92d-4ef2-a71a-1ecd3c32a47b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:26.717353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0357e-d92d-4ef2-a71a-1ecd3c32a47b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:26.717621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0357e-d92d-4ef2-a71a-1ecd3c32a47b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:26.718962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 665/1320] 10.222.0.64 () {54 vars in 965 bytes} [Fri Sep 9 11:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:26.725037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac4f1-18db-4c15-9b71-1d065003ae4c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:26.725358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac4f1-18db-4c15-9b71-1d065003ae4c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:26.725626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac4f1-18db-4c15-9b71-1d065003ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:26.747956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:26.801951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-502ac4f1-18db-4c15-9b71-1d065003ae4c None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:26.803143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-502ac4f1-18db-4c15-9b71-1d065003ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:26.879742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 656/1321] 10.222.0.64 () {58 vars in 1062 bytes} [Fri Sep 9 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:26.889382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0357e-d92d-4ef2-a71a-1ecd3c32a47b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:26.890881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51e0357e-d92d-4ef2-a71a-1ecd3c32a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:26.993749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0357e-d92d-4ef2-a71a-1ecd3c32a47b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:27.065728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:27.066312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:27.066588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:27.066850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:27.068402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:27.075691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:27.176458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:27.177856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7917ba-9c91-4c94-bb70-b1662ca1ab61 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:27.195499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 666/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:30.891218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44ecfb-a3a8-4d97-a29f-504b8ec41d0f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:30.891825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44ecfb-a3a8-4d97-a29f-504b8ec41d0f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:30.891825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44ecfb-a3a8-4d97-a29f-504b8ec41d0f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:30.893013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 657/1323] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:30.898205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891286e-3ab8-4ff3-a536-dcf7606aa39f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:30.899167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891286e-3ab8-4ff3-a536-dcf7606aa39f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:30.899446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891286e-3ab8-4ff3-a536-dcf7606aa39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:30.965876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3891286e-3ab8-4ff3-a536-dcf7606aa39f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:30.967094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3891286e-3ab8-4ff3-a536-dcf7606aa39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:31.027432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:31.071539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 667/1324] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:31.357529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44ecfb-a3a8-4d97-a29f-504b8ec41d0f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:31.359172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2f44ecfb-a3a8-4d97-a29f-504b8ec41d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:31.464456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44ecfb-a3a8-4d97-a29f-504b8ec41d0f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:31.476503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:31.538821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:31.540049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:31.540352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:31.540584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:31.542210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:31.652853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:31.654361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1a71-ef5e-4b51-91f9-8620aa1ed110 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:31.673510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 658/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:33.904416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ed85b-56b4-445f-8363-761541adf9bb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:33.904949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ed85b-56b4-445f-8363-761541adf9bb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:33.904949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ed85b-56b4-445f-8363-761541adf9bb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:33.906253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 668/1326] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:33.912063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a770-0242-4007-b7b5-a6db750f2244 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:33.912644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a770-0242-4007-b7b5-a6db750f2244 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:33.912644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a770-0242-4007-b7b5-a6db750f2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:33.965860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:33.984686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bd43a770-0242-4007-b7b5-a6db750f2244 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:33.985989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bd43a770-0242-4007-b7b5-a6db750f2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:34.084516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 659/1327] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:34.378688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ed85b-56b4-445f-8363-761541adf9bb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:34.380221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-730ed85b-56b4-445f-8363-761541adf9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:34.484022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ed85b-56b4-445f-8363-761541adf9bb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:34.557151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:34.557790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:34.558060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:34.558322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:34.559901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:34.578841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:34.681798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:34.683244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ab9b6-6ac1-42fb-a2ee-6b446fe6408e service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:34.701612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 669/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:37.018041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2f518-2b2f-40b0-878f-5e18a0228989 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:37.018585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2f518-2b2f-40b0-878f-5e18a0228989 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:37.018585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2f518-2b2f-40b0-878f-5e18a0228989 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:37.019902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 660/1329] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:37.025558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed542db-395b-4085-902e-a41f4ea5dba0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:37.025942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed542db-395b-4085-902e-a41f4ea5dba0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:37.026076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed542db-395b-4085-902e-a41f4ea5dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:37.099368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eed542db-395b-4085-902e-a41f4ea5dba0 None None] MFA Rules not processed for user `fa556f2cd54b4d48b2a814a881a5d7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:37.100587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eed542db-395b-4085-902e-a41f4ea5dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:37.179252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:37.213635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 670/1330] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:37.505518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2f518-2b2f-40b0-878f-5e18a0228989 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:37.513838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-01f2f518-2b2f-40b0-878f-5e18a0228989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:37.633966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2f518-2b2f-40b0-878f-5e18a0228989 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:37.658812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:37.712615 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:37.713502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:37.713829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:37.714097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:37.715691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:37.822821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:37.824255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811ee01-fe78-4db2-9985-ca540c73d07f service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:37.842775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 661/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:40.489239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f7fe-725b-432f-91e4-416383570aca None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:40.489813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f7fe-725b-432f-91e4-416383570aca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:40.489913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f7fe-725b-432f-91e4-416383570aca None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:40.491202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 671/1332] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:40.497060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e869675-4333-4f8a-af2e-597ca5f23f7b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:40.497486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e869675-4333-4f8a-af2e-597ca5f23f7b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:40.497639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e869675-4333-4f8a-af2e-597ca5f23f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:40.560657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:40.563238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4e869675-4333-4f8a-af2e-597ca5f23f7b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:40.564447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4e869675-4333-4f8a-af2e-597ca5f23f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:40.662569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 662/1333] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:40.943606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f7fe-725b-432f-91e4-416383570aca None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:40.945674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d158f7fe-725b-432f-91e4-416383570aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:41.047347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f7fe-725b-432f-91e4-416383570aca None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:41.119398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:41.119978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:41.120245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:41.120502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:41.122103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:41.148063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:41.228798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:41.230253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f1f81-e393-468b-801d-c6cb015c72ca service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:41.248388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 672/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:43.528976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaedfd-006a-4a86-8752-19bcccce94f5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:43.529574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaedfd-006a-4a86-8752-19bcccce94f5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:43.529574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaedfd-006a-4a86-8752-19bcccce94f5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:43.530902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 663/1335] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:43.536151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33523-41c4-465a-89fb-34342af2257e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:43.536586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33523-41c4-465a-89fb-34342af2257e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:43.536689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33523-41c4-465a-89fb-34342af2257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:43.601628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-85e33523-41c4-465a-89fb-34342af2257e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:43.602834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-85e33523-41c4-465a-89fb-34342af2257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:43.676667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:43.699256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 673/1336] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:43.984964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaedfd-006a-4a86-8752-19bcccce94f5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:43.986537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-36aaedfd-006a-4a86-8752-19bcccce94f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:44.090692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaedfd-006a-4a86-8752-19bcccce94f5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:44.120635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:44.164509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:44.165183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:44.165487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:44.165753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:44.167340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:44.273598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:44.275132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795920a-00c6-4a09-abcb-67d2be93faa0 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:44.293637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 664/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:47.210691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bc505-ccdb-4117-8175-6a397188911f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:47.211439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bc505-ccdb-4117-8175-6a397188911f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:47.211439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bc505-ccdb-4117-8175-6a397188911f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:47.212566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 674/1338] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:47.218619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef85ba-cbd3-4539-873e-a625daf5c211 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:47.219055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef85ba-cbd3-4539-873e-a625daf5c211 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:47.219245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef85ba-cbd3-4539-873e-a625daf5c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:47.286862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-01ef85ba-cbd3-4539-873e-a625daf5c211 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:47.287979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-01ef85ba-cbd3-4539-873e-a625daf5c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:47.296757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:47.386254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 665/1339] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:47.673238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bc505-ccdb-4117-8175-6a397188911f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:47.674791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f40bc505-ccdb-4117-8175-6a397188911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:47.777696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bc505-ccdb-4117-8175-6a397188911f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:47.849335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:47.849947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:47.850214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:47.850474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:47.852061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:47.886571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:47.958042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:47.959461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3025c5-b904-417d-a6c4-2d51e0e1e0e3 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:47.978636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 675/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:52.389990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35bc4-1ec4-46e0-a93f-c76b07b3be07 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:52.390537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35bc4-1ec4-46e0-a93f-c76b07b3be07 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:52.390537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35bc4-1ec4-46e0-a93f-c76b07b3be07 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:52.392026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 666/1341] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:37:52.397111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72dabf-c2aa-46ca-883a-3890e2c1e133 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:52.397532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72dabf-c2aa-46ca-883a-3890e2c1e133 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:52.397677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72dabf-c2aa-46ca-883a-3890e2c1e133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:52.465669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa72dabf-c2aa-46ca-883a-3890e2c1e133 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:52.466893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa72dabf-c2aa-46ca-883a-3890e2c1e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:52.551864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:52.571058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 676/1342] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:52.850966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35bc4-1ec4-46e0-a93f-c76b07b3be07 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:52.853180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7ef35bc4-1ec4-46e0-a93f-c76b07b3be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:52.960385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35bc4-1ec4-46e0-a93f-c76b07b3be07 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:53.001766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:53.040386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:53.041001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:53.041307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:53.041577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:53.043238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:53.155739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:53.157084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde944-a9a3-4e59-a995-20b5d4133023 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:53.176253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 667/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:37:56.357338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60954f46-3390-4955-b54e-7589917aa415 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:56.357963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60954f46-3390-4955-b54e-7589917aa415 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:56.357963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60954f46-3390-4955-b54e-7589917aa415 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:56.359254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 677/1344] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:37:56.364986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd9aa-dd8d-4406-8fa8-6f89f43059a0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:56.365520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd9aa-dd8d-4406-8fa8-6f89f43059a0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:56.365634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd9aa-dd8d-4406-8fa8-6f89f43059a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:56.434400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-249bd9aa-dd8d-4406-8fa8-6f89f43059a0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:37:56.435614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-249bd9aa-dd8d-4406-8fa8-6f89f43059a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:56.454606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:56.534133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 668/1345] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:37:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:37:56.824262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60954f46-3390-4955-b54e-7589917aa415 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:37:56.825909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-60954f46-3390-4955-b54e-7589917aa415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:56.933903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60954f46-3390-4955-b54e-7589917aa415 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:37:57.010984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:37:57.011585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:37:57.011951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:37:57.012217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:37:57.013838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:37:57.083875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:37:57.172434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:37:57.174060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57827ae2-7a8d-4deb-be5a-d426955cd967 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:37:57.195507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 678/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:37:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:01.896734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356e26-172c-4d6f-a3f0-b9acbe9c64fc None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:01.897269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356e26-172c-4d6f-a3f0-b9acbe9c64fc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:01.897269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356e26-172c-4d6f-a3f0-b9acbe9c64fc None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:01.898613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 669/1347] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:01.904182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809216-7c31-4e2c-991a-b971ac71fe27 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:01.904647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809216-7c31-4e2c-991a-b971ac71fe27 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:01.904759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809216-7c31-4e2c-991a-b971ac71fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:01.975911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b8809216-7c31-4e2c-991a-b971ac71fe27 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:01.977816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b8809216-7c31-4e2c-991a-b971ac71fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:02.075210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:02.077465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 679/1348] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:02.361165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356e26-172c-4d6f-a3f0-b9acbe9c64fc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:02.362763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a6356e26-172c-4d6f-a3f0-b9acbe9c64fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:02.466254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356e26-172c-4d6f-a3f0-b9acbe9c64fc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:02.514523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:02.540906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:02.541547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:02.541824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:02.542211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:02.543802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:02.653950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:02.655387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d9ca6-94e1-4dfe-b7a0-70f9b2e8d0b8 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:02.673308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 670/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:07.635588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58414b-f918-4939-b69f-3e51ee7e7db9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:07.636027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58414b-f918-4939-b69f-3e51ee7e7db9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:07.636145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58414b-f918-4939-b69f-3e51ee7e7db9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:07.637504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 680/1350] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:07.652248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a735d-9103-439f-a9ec-9a081a7392a0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:07.652248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a735d-9103-439f-a9ec-9a081a7392a0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:07.652248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a735d-9103-439f-a9ec-9a081a7392a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:07.757561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-453a735d-9103-439f-a9ec-9a081a7392a0 None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:07.759313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-453a735d-9103-439f-a9ec-9a081a7392a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:07.782709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:07.935665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 671/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:12.015053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013df2f-0b72-4e39-96f8-5e8aad9cb13b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:12.015641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013df2f-0b72-4e39-96f8-5e8aad9cb13b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:12.015895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013df2f-0b72-4e39-96f8-5e8aad9cb13b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:12.017540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 681/1352] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:12.022283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057fd47-82ff-4333-a45a-3a679843d2aa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:12.022677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057fd47-82ff-4333-a45a-3a679843d2aa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:12.022832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057fd47-82ff-4333-a45a-3a679843d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:12.105229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7057fd47-82ff-4333-a45a-3a679843d2aa None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:12.106481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7057fd47-82ff-4333-a45a-3a679843d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:12.182538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:12.222598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 672/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:38:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:13.862325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9490-302a-44f4-8e6a-5bf5de90fdd4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:13.862820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9490-302a-44f4-8e6a-5bf5de90fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:13.863025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9490-302a-44f4-8e6a-5bf5de90fdd4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:13.864375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 682/1354] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:13.869786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780090d9-613f-4d4d-aa5a-0837ba00986c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:13.870228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780090d9-613f-4d4d-aa5a-0837ba00986c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:13.870484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780090d9-613f-4d4d-aa5a-0837ba00986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:13.950879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-780090d9-613f-4d4d-aa5a-0837ba00986c None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:13.952095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-780090d9-613f-4d4d-aa5a-0837ba00986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:14.059578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 673/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:38:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:17.558710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5423fc-e7db-43e6-bbe0-ba3624f8be77 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:17.559564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5423fc-e7db-43e6-bbe0-ba3624f8be77 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:17.559990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5423fc-e7db-43e6-bbe0-ba3624f8be77 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:17.561829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 683/1356] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:17.568358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30da3e1-db28-4033-867b-8fc53ebd4bdc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:17.568873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30da3e1-db28-4033-867b-8fc53ebd4bdc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:17.569462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30da3e1-db28-4033-867b-8fc53ebd4bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:17.624844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:17.663335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c30da3e1-db28-4033-867b-8fc53ebd4bdc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:17.664785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c30da3e1-db28-4033-867b-8fc53ebd4bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:17.773882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 674/1357] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:18.076399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64052-2aef-4ef7-8d9a-b0e300ecb31c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:18.076827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64052-2aef-4ef7-8d9a-b0e300ecb31c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:18.077338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64052-2aef-4ef7-8d9a-b0e300ecb31c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:18.078967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 684/1358] 10.222.0.64 () {54 vars in 962 bytes} [Fri Sep 9 11:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:18.087748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974ebf-6f7f-41eb-bede-095a8d355415 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:18.088211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974ebf-6f7f-41eb-bede-095a8d355415 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:18.088661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974ebf-6f7f-41eb-bede-095a8d355415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:18.181132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-26974ebf-6f7f-41eb-bede-095a8d355415 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:18.182653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-26974ebf-6f7f-41eb-bede-095a8d355415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:18.238211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:18.316987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 675/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Fri Sep 9 11:38:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:38:18.325412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64052-2aef-4ef7-8d9a-b0e300ecb31c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:18.326958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2fe64052-2aef-4ef7-8d9a-b0e300ecb31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:18.491241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64052-2aef-4ef7-8d9a-b0e300ecb31c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:18.570014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:18.615009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:18.615982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:18.616474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:18.617021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:18.619556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:18.723112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:18.724770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3c3de-e400-4b4c-b519-baf3713a6705 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:18.746159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 685/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:21.138774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c49910-5595-489c-8047-49f80fccfa93 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:21.139647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c49910-5595-489c-8047-49f80fccfa93 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:21.140065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c49910-5595-489c-8047-49f80fccfa93 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:21.141616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 676/1361] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:21.147150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3968ad-27aa-4aed-b60c-ee672ab0fdd8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:21.147586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3968ad-27aa-4aed-b60c-ee672ab0fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:21.147705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3968ad-27aa-4aed-b60c-ee672ab0fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:21.228714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3e3968ad-27aa-4aed-b60c-ee672ab0fdd8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:21.229928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3e3968ad-27aa-4aed-b60c-ee672ab0fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:21.270581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:21.334508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 686/1362] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:21.643414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c49910-5595-489c-8047-49f80fccfa93 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:21.644954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b0c49910-5595-489c-8047-49f80fccfa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:21.833379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c49910-5595-489c-8047-49f80fccfa93 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:21.847285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:21.986894 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:21.987461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:21.987766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:21.988061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:21.990296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:22.088826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:22.090693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cb9a8-e1b2-4b52-8a0b-16f68feecc86 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:22.110796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 677/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:24.879818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceae94f-17a6-4496-9329-43ae49c9ba84 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:24.880359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceae94f-17a6-4496-9329-43ae49c9ba84 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:24.880581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceae94f-17a6-4496-9329-43ae49c9ba84 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:24.882053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 687/1364] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:24.887715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2924d-a85f-4479-9d8c-23b4fdb25a2b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:24.888656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2924d-a85f-4479-9d8c-23b4fdb25a2b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:24.889326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2924d-a85f-4479-9d8c-23b4fdb25a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:24.912729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:24.971404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-02c2924d-a85f-4479-9d8c-23b4fdb25a2b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:24.972866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-02c2924d-a85f-4479-9d8c-23b4fdb25a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:25.084080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 678/1365] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:25.396559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804a8cc-86e5-4455-a391-e4e56cce9538 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:25.397114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804a8cc-86e5-4455-a391-e4e56cce9538 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:25.397571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804a8cc-86e5-4455-a391-e4e56cce9538 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:25.399173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 688/1366] 10.222.0.64 () {54 vars in 962 bytes} [Fri Sep 9 11:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:25.405549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545bf3-4675-46a8-a175-5fe311bb0f46 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:25.405836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545bf3-4675-46a8-a175-5fe311bb0f46 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:25.406107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545bf3-4675-46a8-a175-5fe311bb0f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:25.496370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-58545bf3-4675-46a8-a175-5fe311bb0f46 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:25.497628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-58545bf3-4675-46a8-a175-5fe311bb0f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:25.535666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:25.631424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 679/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Fri Sep 9 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:25.639872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804a8cc-86e5-4455-a391-e4e56cce9538 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:25.641576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a804a8cc-86e5-4455-a391-e4e56cce9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:25.817918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804a8cc-86e5-4455-a391-e4e56cce9538 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:25.846185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:25.935243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf954-a6b6-448a-96cd-75ea69b4fcf9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:25.935811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf954-a6b6-448a-96cd-75ea69b4fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:25.935811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf954-a6b6-448a-96cd-75ea69b4fcf9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:25.937172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 680/1368] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:25.942419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aaae9-3772-44b1-acf6-9c5bd2539dec None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:25.942707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aaae9-3772-44b1-acf6-9c5bd2539dec None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:25.942983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aaae9-3772-44b1-acf6-9c5bd2539dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:25.952677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:25.953805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:25.953805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:25.953805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:25.955424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:26.019083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-523aaae9-3772-44b1-acf6-9c5bd2539dec None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:26.020622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-523aaae9-3772-44b1-acf6-9c5bd2539dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:26.064689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:26.066497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145e77f-5615-4f39-9c6a-fb392c45ef7b service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:26.090490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 689/1369] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:26.143679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:26.151402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 681/1370] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:38:26.521735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a110-f8e3-4e91-8bfb-29d320b51126 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:26.521735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a110-f8e3-4e91-8bfb-29d320b51126 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:26.521914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a110-f8e3-4e91-8bfb-29d320b51126 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:26.523270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 690/1371] 10.222.0.64 () {54 vars in 964 bytes} [Fri Sep 9 11:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:26.529878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27414a-be5a-43b3-9e2f-0180f6870ffa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:26.530400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27414a-be5a-43b3-9e2f-0180f6870ffa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:26.530821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27414a-be5a-43b3-9e2f-0180f6870ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:26.647426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fa27414a-be5a-43b3-9e2f-0180f6870ffa None None] MFA Rules not processed for user `d02a5e02723a4c29ad8872f269138453`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:26.649446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fa27414a-be5a-43b3-9e2f-0180f6870ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:26.731576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 682/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Fri Sep 9 11:38:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:26.739498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a110-f8e3-4e91-8bfb-29d320b51126 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:26.741276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d84a110-f8e3-4e91-8bfb-29d320b51126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:26.780042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:26.883294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a110-f8e3-4e91-8bfb-29d320b51126 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:26.977970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:26.979045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:26.979386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:26.980024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:26.982288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:27.084186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:27.123347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:27.125572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb5afb-057b-478d-9d22-65f289180fa9 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:27.156085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 691/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:28.591446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d001b-8ce9-4f61-89b9-7522521c4f6e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:28.592005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d001b-8ce9-4f61-89b9-7522521c4f6e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:28.592005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d001b-8ce9-4f61-89b9-7522521c4f6e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:28.593357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 683/1374] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:28.598880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42113ab-f1aa-412c-ad43-76a557fff69f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:28.599307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42113ab-f1aa-412c-ad43-76a557fff69f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:28.599430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42113ab-f1aa-412c-ad43-76a557fff69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:28.674635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d42113ab-f1aa-412c-ad43-76a557fff69f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:28.675857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d42113ab-f1aa-412c-ad43-76a557fff69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:28.784185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 692/1375] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:38:29.082900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d001b-8ce9-4f61-89b9-7522521c4f6e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:29.085339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e06d001b-8ce9-4f61-89b9-7522521c4f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:29.194628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:29.286603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d001b-8ce9-4f61-89b9-7522521c4f6e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:29.426808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:29.427419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:29.427695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:29.427963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:29.429692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:29.483641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:29.578060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:29.578060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce270f-8f26-4e87-9384-70630d188fac service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:29.578060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 684/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:32.043876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec476f-ce83-400c-ad4c-501c6a89c705 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:32.044483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec476f-ce83-400c-ad4c-501c6a89c705 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:32.044483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec476f-ce83-400c-ad4c-501c6a89c705 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:32.046081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 693/1377] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:32.051895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e31a9-b2c5-4064-905b-ecefbb47dbd2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:32.052425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e31a9-b2c5-4064-905b-ecefbb47dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:32.052425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e31a9-b2c5-4064-905b-ecefbb47dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:32.121728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b74e31a9-b2c5-4064-905b-ecefbb47dbd2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:32.122947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b74e31a9-b2c5-4064-905b-ecefbb47dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:32.225685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 685/1378] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:32.517238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec476f-ce83-400c-ad4c-501c6a89c705 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:32.519000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-95ec476f-ce83-400c-ad4c-501c6a89c705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:32.562820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:32.695609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec476f-ce83-400c-ad4c-501c6a89c705 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:32.820468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:32.826381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:32.826988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:32.827264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:32.827534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:32.829122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:32.929799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:32.931835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a689f7-42d5-4c27-9d88-41f6c93e3b32 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:32.951285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 694/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:35.271991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434338ca-f145-49c1-a36b-516b43b4f449 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:35.272553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434338ca-f145-49c1-a36b-516b43b4f449 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:35.272553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434338ca-f145-49c1-a36b-516b43b4f449 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:35.274726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 686/1380] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:35.281108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405c65-3ea3-40f6-885f-5f308b4bb47a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:35.281613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405c65-3ea3-40f6-885f-5f308b4bb47a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:35.281731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405c65-3ea3-40f6-885f-5f308b4bb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:35.365652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e9405c65-3ea3-40f6-885f-5f308b4bb47a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:35.368407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9405c65-3ea3-40f6-885f-5f308b4bb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:35.473326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:35.528763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 695/1381] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:35.840439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434338ca-f145-49c1-a36b-516b43b4f449 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:35.842276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-434338ca-f145-49c1-a36b-516b43b4f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:35.877607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:36.034145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434338ca-f145-49c1-a36b-516b43b4f449 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:36.133046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:36.148667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:36.149812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:36.150084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:36.150343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:36.151953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:36.270423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:36.272029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe4ffc-992d-4faf-86f7-de3e0199caf8 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:36.292220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 687/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:38.668901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398860-f34c-46d4-8f8b-cd0eea9c4ef4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:38.669596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398860-f34c-46d4-8f8b-cd0eea9c4ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:38.669596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398860-f34c-46d4-8f8b-cd0eea9c4ef4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:38.671010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 696/1383] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:38.676310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8982b-0dfc-49cc-9a06-2918023863ef None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:38.676756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8982b-0dfc-49cc-9a06-2918023863ef None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:38.676873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8982b-0dfc-49cc-9a06-2918023863ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:38.748709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-70f8982b-0dfc-49cc-9a06-2918023863ef None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:38.750012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-70f8982b-0dfc-49cc-9a06-2918023863ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:38.813016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:38.854328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 688/1384] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:39.156632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398860-f34c-46d4-8f8b-cd0eea9c4ef4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:39.158182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-73398860-f34c-46d4-8f8b-cd0eea9c4ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:39.316037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398860-f34c-46d4-8f8b-cd0eea9c4ef4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:39.373467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:39.441287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:39.441915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:39.442204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:39.442484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:39.444175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:39.550937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:39.552611 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbab2-8e4c-48d1-bb0d-c2c1f1dff34c service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:39.575910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 697/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:41.844379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c0b5-4818-42b4-865a-09d97805d811 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:41.844940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c0b5-4818-42b4-865a-09d97805d811 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:41.844940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3c0b5-4818-42b4-865a-09d97805d811 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:41.846289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 689/1386] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:41.851512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3eab-78df-41b8-bbd1-c67cd9776cfd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:41.851971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3eab-78df-41b8-bbd1-c67cd9776cfd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:41.852063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3eab-78df-41b8-bbd1-c67cd9776cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:41.918130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fe0b3eab-78df-41b8-bbd1-c67cd9776cfd None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:41.919254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe0b3eab-78df-41b8-bbd1-c67cd9776cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:41.929431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:42.024897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 698/1387] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:42.352646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3c0b5-4818-42b4-865a-09d97805d811 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:42.354356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9ae3c0b5-4818-42b4-865a-09d97805d811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:42.543989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3c0b5-4818-42b4-865a-09d97805d811 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:42.600238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:42.686037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:42.686582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:42.686862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:42.687132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:42.688739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:42.803611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:42.805802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b5891-3a5c-41ed-8a3e-f0819e52adeb service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:42.827859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 690/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:43.315446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a63ffd-8968-4eab-b48b-8c05ae440b6e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:43.316053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a63ffd-8968-4eab-b48b-8c05ae440b6e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:43.316053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a63ffd-8968-4eab-b48b-8c05ae440b6e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:43.317343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 699/1389] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:43.322732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578365-0644-47d7-b97a-11df84dc834a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:43.323186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578365-0644-47d7-b97a-11df84dc834a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:43.323446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578365-0644-47d7-b97a-11df84dc834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:43.389689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:43.392548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3d578365-0644-47d7-b97a-11df84dc834a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:43.393794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3d578365-0644-47d7-b97a-11df84dc834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:43.494012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 691/1390] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:43.795339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d929f-a0a8-4a47-adc4-d373cc04d2e9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:43.795633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d929f-a0a8-4a47-adc4-d373cc04d2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:43.795952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d929f-a0a8-4a47-adc4-d373cc04d2e9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:43.797417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 700/1391] 10.222.0.64 () {54 vars in 966 bytes} [Fri Sep 9 11:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:43.802933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1ae8-54a5-42a5-b29b-43d2098d2516 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:43.803220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1ae8-54a5-42a5-b29b-43d2098d2516 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:43.803491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1ae8-54a5-42a5-b29b-43d2098d2516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:43.880979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fdce1ae8-54a5-42a5-b29b-43d2098d2516 None None] MFA Rules not processed for user `3f69a6b87a274ca3b4d658080992abb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:43.882284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fdce1ae8-54a5-42a5-b29b-43d2098d2516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:43.957447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:43.964180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 692/1392] 10.222.0.64 () {58 vars in 1063 bytes} [Fri Sep 9 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:43.973615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d929f-a0a8-4a47-adc4-d373cc04d2e9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:43.975126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b6d929f-a0a8-4a47-adc4-d373cc04d2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:44.078769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d929f-a0a8-4a47-adc4-d373cc04d2e9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:44.116885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:44.154998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:44.155504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:44.155773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:44.156036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:44.157628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:44.266685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:44.268119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98e0b0-243f-4883-9a5f-4e7f6af6f765 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:44.287067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 701/1393] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:45.212878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18f7e-0088-47ff-9902-58d14eb1d590 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.213539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18f7e-0088-47ff-9902-58d14eb1d590 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.213539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e18f7e-0088-47ff-9902-58d14eb1d590 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.214814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 693/1394] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:45.220239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719633c-7cdf-4c89-8691-3f1b8b6b1e72 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.220699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719633c-7cdf-4c89-8691-3f1b8b6b1e72 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.220819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719633c-7cdf-4c89-8691-3f1b8b6b1e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.288406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9719633c-7cdf-4c89-8691-3f1b8b6b1e72 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:45.289471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9719633c-7cdf-4c89-8691-3f1b8b6b1e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:45.301417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580673c-6501-43c7-8678-23fc039ff7ed None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.301756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580673c-6501-43c7-8678-23fc039ff7ed None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.302244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580673c-6501-43c7-8678-23fc039ff7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.309079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:45.374732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b580673c-6501-43c7-8678-23fc039ff7ed None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:45.375942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b580673c-6501-43c7-8678-23fc039ff7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:45.391485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 702/1395] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:45.465641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 694/1396] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:38:45.509519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90208-384d-4e75-b85b-85f0c806808b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.509806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90208-384d-4e75-b85b-85f0c806808b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.510071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90208-384d-4e75-b85b-85f0c806808b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.511491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 703/1397] 10.222.0.64 () {54 vars in 943 bytes} [Fri Sep 9 11:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:45.517840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.518128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.518396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.605296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] MFA Rules not processed for user `90ff1707eb264477b0a120e10c5d7a63`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:45.605296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:45.629371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:45.684083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90208-384d-4e75-b85b-85f0c806808b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:45.685668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0e90208-384d-4e75-b85b-85f0c806808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:45.709055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 695/1398] 10.222.0.64 () {58 vars in 1040 bytes} [Fri Sep 9 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:45.719166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:45.729656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b970-0a28-4de0-833f-9f1dcb6de8bd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:45.834305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:45.834914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.835036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90208-384d-4e75-b85b-85f0c806808b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:45.835186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.835449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.837728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:45.838601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:45.874709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:45.923042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:45.924629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff536-1a57-4c6f-9a0c-ae7942ea51ef service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:45.932656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 696/1399] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 11:38:45.953313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:45.953899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:45.954151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:45.954415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:45.956018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:46.049647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:46.051303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac8b8f-d525-46e3-a300-6a84d8614e27 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:46.069199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 704/1400] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:38:48.468850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c661-9c2e-4235-afaf-8f7306601ac3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:48.469426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c661-9c2e-4235-afaf-8f7306601ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:48.469570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c661-9c2e-4235-afaf-8f7306601ac3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:48.471071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 697/1401] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:48.476743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5045-340c-44a4-ba7a-3f6c9c1afc66 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:48.477430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5045-340c-44a4-ba7a-3f6c9c1afc66 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:48.477541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5045-340c-44a4-ba7a-3f6c9c1afc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:48.487527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:48.552217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c18c5045-340c-44a4-ba7a-3f6c9c1afc66 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:48.553462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c18c5045-340c-44a4-ba7a-3f6c9c1afc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:48.673783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 705/1402] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:48.997507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c661-9c2e-4235-afaf-8f7306601ac3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:48.999054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5597c661-9c2e-4235-afaf-8f7306601ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:49.168675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c661-9c2e-4235-afaf-8f7306601ac3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:49.198533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:49.303523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:49.304050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:49.304329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:49.304598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:49.306399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:49.418115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:49.419768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d52c9-7f03-40f0-9319-6a33aa2add6a service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:49.439249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 698/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:51.806196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b88be-f916-421c-bb11-b0f73d49706a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:51.806755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b88be-f916-421c-bb11-b0f73d49706a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:51.806755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b88be-f916-421c-bb11-b0f73d49706a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:51.808227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 706/1404] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:51.813484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9696cb-c540-4dbb-9218-4d2f5c94baa0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:51.813937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9696cb-c540-4dbb-9218-4d2f5c94baa0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:51.814023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9696cb-c540-4dbb-9218-4d2f5c94baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:51.863240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:51.892688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cb9696cb-c540-4dbb-9218-4d2f5c94baa0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:51.893905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cb9696cb-c540-4dbb-9218-4d2f5c94baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:52.002618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 699/1405] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:52.296951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b88be-f916-421c-bb11-b0f73d49706a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:52.298848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-241b88be-f916-421c-bb11-b0f73d49706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:52.395576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:52.465382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b88be-f916-421c-bb11-b0f73d49706a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:52.592533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:52.593482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:52.593939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:52.594239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:52.595945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:52.655678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:52.705630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:52.707243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334eb4c-f35a-49a3-8165-c20124c000dc service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:52.729054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 707/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:38:55.104461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897df79d-b99b-4082-9735-d60b43ac22f1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:55.105050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897df79d-b99b-4082-9735-d60b43ac22f1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:55.105050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897df79d-b99b-4082-9735-d60b43ac22f1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:55.107725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 700/1407] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:38:55.112411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e14e-a50e-47bb-b3d6-a202b9b70b68 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:55.113003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e14e-a50e-47bb-b3d6-a202b9b70b68 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:55.113003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e14e-a50e-47bb-b3d6-a202b9b70b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:55.213571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0651e14e-a50e-47bb-b3d6-a202b9b70b68 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:38:55.215209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0651e14e-a50e-47bb-b3d6-a202b9b70b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:55.323742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 708/1408] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:38:55.629463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897df79d-b99b-4082-9735-d60b43ac22f1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:38:55.631064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-897df79d-b99b-4082-9735-d60b43ac22f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:55.754635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:55.798490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897df79d-b99b-4082-9735-d60b43ac22f1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:38:55.926913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:38:55.927451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:38:55.927728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:38:55.927995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:38:55.933157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:38:56.014194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:38:56.031700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:38:56.033354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d9b36-2483-4003-b5a6-17948c2fc7e9 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:38:56.052905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 701/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:05.321655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:06.050902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=13 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:10.377698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b5f1-0b8e-418f-af25-2556e4a0ac13 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:10.378290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b5f1-0b8e-418f-af25-2556e4a0ac13 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:10.378290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b5f1-0b8e-418f-af25-2556e4a0ac13 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:10.379622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 709/1410] 10.222.0.64 () {54 vars in 918 bytes} [Fri Sep 9 11:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:10.385256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9454-6e7f-4ee4-bc42-73437633eae6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:10.385674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9454-6e7f-4ee4-bc42-73437633eae6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:10.385797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9454-6e7f-4ee4-bc42-73437633eae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:10.461168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a1dd9454-6e7f-4ee4-bc42-73437633eae6 None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:10.462937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a1dd9454-6e7f-4ee4-bc42-73437633eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:10.571561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 702/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Sep 9 11:39:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:10.585670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be716fd-8137-49fb-a308-866d43b96572 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:10.585950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be716fd-8137-49fb-a308-866d43b96572 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:10.586239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be716fd-8137-49fb-a308-866d43b96572 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:10.587554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 710/1412] 10.222.0.64 () {54 vars in 918 bytes} [Fri Sep 9 11:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:10.592492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435289a7-bba4-4c97-9e5f-d10398876bc9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:10.592772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435289a7-bba4-4c97-9e5f-d10398876bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:10.593040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435289a7-bba4-4c97-9e5f-d10398876bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:10.666953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:10.669924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-435289a7-bba4-4c97-9e5f-d10398876bc9 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:10.671145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-435289a7-bba4-4c97-9e5f-d10398876bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:10.790297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 703/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Sep 9 11:39:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:13.389673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab4dc-06b9-4ed4-9624-e8768e35792c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:13.390305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab4dc-06b9-4ed4-9624-e8768e35792c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:13.390305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab4dc-06b9-4ed4-9624-e8768e35792c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:13.391473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:13.396995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788f2a-9e6e-4061-a705-fe13811181aa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:13.397452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788f2a-9e6e-4061-a705-fe13811181aa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:13.397563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788f2a-9e6e-4061-a705-fe13811181aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:13.467886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-34788f2a-9e6e-4061-a705-fe13811181aa None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:13.469086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-34788f2a-9e6e-4061-a705-fe13811181aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:13.523595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:13.567271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:13.862673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab4dc-06b9-4ed4-9624-e8768e35792c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:13.864186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51eab4dc-06b9-4ed4-9624-e8768e35792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:14.009649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab4dc-06b9-4ed4-9624-e8768e35792c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:14.081535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:14.121961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:14.122498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:14.122773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:14.123042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:14.124619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:14.214156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:14.215748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa89537-ccdc-4c72-b6ad-6eef85a7c2c2 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:14.233418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 712/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:15.390331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908288b-c3cb-427e-af79-3d712e825247 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:15.390331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908288b-c3cb-427e-af79-3d712e825247 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:15.390331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908288b-c3cb-427e-af79-3d712e825247 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:15.390331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:15.394619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a41aa-ecc4-4c4f-a7aa-bcb78cdc4865 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:15.395012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a41aa-ecc4-4c4f-a7aa-bcb78cdc4865 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:15.395186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a41aa-ecc4-4c4f-a7aa-bcb78cdc4865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:15.471511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b00a41aa-ecc4-4c4f-a7aa-bcb78cdc4865 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:15.472719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b00a41aa-ecc4-4c4f-a7aa-bcb78cdc4865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:15.500694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:15.572182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:15.721111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908288b-c3cb-427e-af79-3d712e825247 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:15.722820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9908288b-c3cb-427e-af79-3d712e825247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:15.867355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908288b-c3cb-427e-af79-3d712e825247 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:15.908772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:15.982065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:15.982593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:15.982954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:15.983226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:15.984850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:16.074792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:16.076398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4351d5-0114-446a-9838-31edafbb6d13 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:16.095107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 706/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:17.247314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4dd4-1170-4646-ade2-d789187cd52f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:17.247759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4dd4-1170-4646-ade2-d789187cd52f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:17.247870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4dd4-1170-4646-ade2-d789187cd52f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:17.249274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:17.255577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153032-06e0-49c8-ab07-f32e58639b31 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:17.256018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153032-06e0-49c8-ab07-f32e58639b31 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:17.256185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153032-06e0-49c8-ab07-f32e58639b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:17.311410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:17.334088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3d153032-06e0-49c8-ab07-f32e58639b31 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:17.335824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3d153032-06e0-49c8-ab07-f32e58639b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:17.434636 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:17.587519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b4dd4-1170-4646-ade2-d789187cd52f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:17.589033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-319b4dd4-1170-4646-ade2-d789187cd52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:17.737486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b4dd4-1170-4646-ade2-d789187cd52f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:17.750022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:17.852770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:17.853423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:17.853782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:17.854051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:17.855636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:17.944434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:17.946657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3115c3-17a3-47a2-8488-8530559d5da9 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:17.964883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 715/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:19.073437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf65471-d680-4750-bbe6-5f6e53603ab4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:19.073984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf65471-d680-4750-bbe6-5f6e53603ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:19.073984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf65471-d680-4750-bbe6-5f6e53603ab4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:19.075354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:19.081355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b415-ceba-40fb-afed-780cffba48ee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:19.081763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b415-ceba-40fb-afed-780cffba48ee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:19.081894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b415-ceba-40fb-afed-780cffba48ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:19.103180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:19.164988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f8c5b415-ceba-40fb-afed-780cffba48ee None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:19.166213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f8c5b415-ceba-40fb-afed-780cffba48ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:19.261173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:19.412219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf65471-d680-4750-bbe6-5f6e53603ab4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:19.413681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5bf65471-d680-4750-bbe6-5f6e53603ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:19.522539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:19.559258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf65471-d680-4750-bbe6-5f6e53603ab4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:19.674284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:19.674819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:19.675094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:19.675357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:19.676982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:19.753875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:19.767336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:19.768927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38262db-200e-4700-ac6e-dbcda7cc4bc8 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:19.787823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 709/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:20.889659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faba4d-d940-4fd3-bca8-d20066b890f8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:20.890228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faba4d-d940-4fd3-bca8-d20066b890f8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:20.890228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faba4d-d940-4fd3-bca8-d20066b890f8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:20.891460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:20.897736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30ff06-763f-46a7-965e-40362303eed1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:20.898147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30ff06-763f-46a7-965e-40362303eed1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:20.898330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30ff06-763f-46a7-965e-40362303eed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:20.973475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bd30ff06-763f-46a7-965e-40362303eed1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:20.974668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bd30ff06-763f-46a7-965e-40362303eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:21.071602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:21.221574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faba4d-d940-4fd3-bca8-d20066b890f8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:21.223087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f9faba4d-d940-4fd3-bca8-d20066b890f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:21.306933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:21.368332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faba4d-d940-4fd3-bca8-d20066b890f8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:21.482513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:21.483053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:21.483321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:21.483583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:21.485173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:21.536917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:21.578170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:21.579872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18b5dd-6044-4b88-ae6e-e9a268b06888 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:21.598259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 718/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:22.727973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dfdb4-d55c-47f4-945f-c143381a6308 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:22.728554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dfdb4-d55c-47f4-945f-c143381a6308 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:22.728554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dfdb4-d55c-47f4-945f-c143381a6308 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:22.729932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:22.736291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad042f-1582-4f55-b503-036599f70874 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:22.736734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad042f-1582-4f55-b503-036599f70874 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:22.736855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad042f-1582-4f55-b503-036599f70874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:22.814484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-30ad042f-1582-4f55-b503-036599f70874 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:22.815687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-30ad042f-1582-4f55-b503-036599f70874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:22.921285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:23.072742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dfdb4-d55c-47f4-945f-c143381a6308 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:23.074299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d59dfdb4-d55c-47f4-945f-c143381a6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:23.122926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:23.221624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dfdb4-d55c-47f4-945f-c143381a6308 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:23.335355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:23.335955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:23.336342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:23.336646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:23.338365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:23.345367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:23.428342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:23.430630 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f7121-de95-4fa9-b202-712e2df88e34 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:23.449199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 712/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:24.575981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7f07-27f3-4743-ae0e-62253c1de86f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:24.576576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7f07-27f3-4743-ae0e-62253c1de86f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:24.576576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7f07-27f3-4743-ae0e-62253c1de86f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:24.577909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:24.584223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe669f-c373-4e88-a88d-056bf345f782 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:24.584658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe669f-c373-4e88-a88d-056bf345f782 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:24.584761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe669f-c373-4e88-a88d-056bf345f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:24.665812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-90fe669f-c373-4e88-a88d-056bf345f782 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:24.667025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-90fe669f-c373-4e88-a88d-056bf345f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:24.737573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:24.766818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:24.918097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7f07-27f3-4743-ae0e-62253c1de86f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:24.919561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-802f7f07-27f3-4743-ae0e-62253c1de86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:24.937339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:25.064521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7f07-27f3-4743-ae0e-62253c1de86f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:25.152360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:25.178612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:25.179139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:25.179749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:25.180731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:25.183093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:25.274095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:25.275913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611931e-cc47-4c65-befd-112c4444bc80 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:25.294241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 721/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:26.428168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49a5-4ba8-4747-a919-331ce72845a5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:26.428749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49a5-4ba8-4747-a919-331ce72845a5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:26.428749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49a5-4ba8-4747-a919-331ce72845a5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:26.430134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:26.436341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9927c2-e944-4721-a59c-3177e963da8d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:26.436818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9927c2-e944-4721-a59c-3177e963da8d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:26.436916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9927c2-e944-4721-a59c-3177e963da8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:26.519484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8a9927c2-e944-4721-a59c-3177e963da8d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:26.520694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8a9927c2-e944-4721-a59c-3177e963da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:26.562344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:26.618646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:26.770068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad49a5-4ba8-4747-a919-331ce72845a5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:26.771587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49ad49a5-4ba8-4747-a919-331ce72845a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:26.917659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad49a5-4ba8-4747-a919-331ce72845a5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:26.972022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:27.031016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:27.031541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:27.031822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:27.032086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:27.033716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:27.123059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:27.124668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac99958-e5d7-4df2-b569-71306564a08c service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:27.143170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 715/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:28.295158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fd4c9-1ec5-4ec2-8e02-a7885f2c26af None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:28.295758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fd4c9-1ec5-4ec2-8e02-a7885f2c26af None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:28.295758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fd4c9-1ec5-4ec2-8e02-a7885f2c26af None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:28.297034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:28.303118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49481c4b-4a22-456d-8c52-177361d217e9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:28.303579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49481c4b-4a22-456d-8c52-177361d217e9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:28.303684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49481c4b-4a22-456d-8c52-177361d217e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:28.379989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-49481c4b-4a22-456d-8c52-177361d217e9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:28.381200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49481c4b-4a22-456d-8c52-177361d217e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:28.383852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:28.479595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:28.642836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fd4c9-1ec5-4ec2-8e02-a7885f2c26af None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:28.644331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac4fd4c9-1ec5-4ec2-8e02-a7885f2c26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:28.788904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fd4c9-1ec5-4ec2-8e02-a7885f2c26af None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:28.815975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:28.903978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:28.904483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:28.904755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:28.905019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:28.906656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:28.995702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:28.997346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805370e-3b85-4d93-b39b-0905083d2459 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:29.015560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 724/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:31.090610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fc34f-5c7a-440b-9087-d1bce82de443 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:31.091187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fc34f-5c7a-440b-9087-d1bce82de443 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:31.091187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fc34f-5c7a-440b-9087-d1bce82de443 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:31.092515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:31.098040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc9df6-498a-4d6c-9f9f-ccd0c839d66b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:31.098404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc9df6-498a-4d6c-9f9f-ccd0c839d66b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:31.098512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc9df6-498a-4d6c-9f9f-ccd0c839d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:31.139788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:31.163823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4ffc9df6-498a-4d6c-9f9f-ccd0c839d66b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:31.165795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ffc9df6-498a-4d6c-9f9f-ccd0c839d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:31.262477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:31.548883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fc34f-5c7a-440b-9087-d1bce82de443 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:31.550467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-884fc34f-5c7a-440b-9087-d1bce82de443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:31.654586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fc34f-5c7a-440b-9087-d1bce82de443 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:31.802838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:31.845601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:31.846203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:31.846477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:31.846740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:31.848325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:31.957143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:31.958624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcc55e-1d2b-4d99-ac53-a21ccdd90ae7 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:31.976599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 718/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:34.268067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1096e9-c253-45cf-872b-3e1c01b80932 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:34.268643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1096e9-c253-45cf-872b-3e1c01b80932 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:34.268643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1096e9-c253-45cf-872b-3e1c01b80932 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:34.270016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:34.275887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e3d06-e747-4e24-8157-5634a096c28b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:34.276310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e3d06-e747-4e24-8157-5634a096c28b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:34.276421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e3d06-e747-4e24-8157-5634a096c28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:34.342421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e37e3d06-e747-4e24-8157-5634a096c28b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:34.343874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e37e3d06-e747-4e24-8157-5634a096c28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:34.356454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:34.439747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:34.734155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1096e9-c253-45cf-872b-3e1c01b80932 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:34.735749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3b1096e9-c253-45cf-872b-3e1c01b80932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:34.835942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1096e9-c253-45cf-872b-3e1c01b80932 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:34.849448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:34.910907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:34.911416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:34.911686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:34.911945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:34.913545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:35.020756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:35.022207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4000-16e7-4eef-8c7b-bd428e449839 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:35.040248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 727/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:37.559092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f080-ebd2-492e-aef3-ba5edb6db43a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:37.559665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f080-ebd2-492e-aef3-ba5edb6db43a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:37.559665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f080-ebd2-492e-aef3-ba5edb6db43a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:37.560953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:37.566410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b1ad-cd10-4e75-857d-b34420536217 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:37.566861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b1ad-cd10-4e75-857d-b34420536217 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:37.566963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b1ad-cd10-4e75-857d-b34420536217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:37.614741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:37.634552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a357b1ad-cd10-4e75-857d-b34420536217 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:37.634826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a357b1ad-cd10-4e75-857d-b34420536217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:37.730779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:38.020211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f080-ebd2-492e-aef3-ba5edb6db43a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:38.021809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-04e6f080-ebd2-492e-aef3-ba5edb6db43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:38.125745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f080-ebd2-492e-aef3-ba5edb6db43a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:38.165918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:38.199205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:38.199797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:38.200067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:38.200326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:38.201977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:38.316527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:38.317978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0d4b-7393-4262-bd4e-6cea147a5804 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:38.343912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 721/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:40.629919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382e5fd-b1ff-4a0a-ae24-22ec92db470d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:40.630370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382e5fd-b1ff-4a0a-ae24-22ec92db470d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:40.630468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382e5fd-b1ff-4a0a-ae24-22ec92db470d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:40.631788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:39:40.637500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8ad7-f8bc-45bb-a97e-fc7ab828e8e2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:40.637967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8ad7-f8bc-45bb-a97e-fc7ab828e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:40.638065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8ad7-f8bc-45bb-a97e-fc7ab828e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:40.703643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-342b8ad7-f8bc-45bb-a97e-fc7ab828e8e2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:40.704841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-342b8ad7-f8bc-45bb-a97e-fc7ab828e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:40.725677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:40.800200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:41.089541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382e5fd-b1ff-4a0a-ae24-22ec92db470d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:41.091102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1382e5fd-b1ff-4a0a-ae24-22ec92db470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:41.198705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382e5fd-b1ff-4a0a-ae24-22ec92db470d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:41.218732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:41.273320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:41.274412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:41.274689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:41.274956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:41.276551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:41.393797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:41.395156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d431d5c-5f71-4215-ae24-860e692b5b6a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:41.415187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 730/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:43.937035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167fe1-396a-4dc0-a9f0-a4f695ef7f0f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:43.937599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167fe1-396a-4dc0-a9f0-a4f695ef7f0f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:43.937599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167fe1-396a-4dc0-a9f0-a4f695ef7f0f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:43.938932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:43.944409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a218-ce08-42cc-b6af-cc39ec7d9119 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:43.944809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a218-ce08-42cc-b6af-cc39ec7d9119 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:43.944952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a218-ce08-42cc-b6af-cc39ec7d9119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:44.015743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:44.018730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1c48a218-ce08-42cc-b6af-cc39ec7d9119 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:44.019948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1c48a218-ce08-42cc-b6af-cc39ec7d9119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:44.117525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:44.405703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167fe1-396a-4dc0-a9f0-a4f695ef7f0f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:44.407235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3f167fe1-396a-4dc0-a9f0-a4f695ef7f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:44.515332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167fe1-396a-4dc0-a9f0-a4f695ef7f0f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:44.567126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:44.592080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:44.592719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:44.593270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:44.593554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:44.595162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:44.715044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:44.716519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae0e6-ebfa-4393-8f33-bf7acae8c111 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:44.735624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 724/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:46.973427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43197e01-39e4-4543-9478-fd9017134c07 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:46.973982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43197e01-39e4-4543-9478-fd9017134c07 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:46.973982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43197e01-39e4-4543-9478-fd9017134c07 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:46.975341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:46.980975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d988-828b-4363-aeb7-84528f97532c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:46.981475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d988-828b-4363-aeb7-84528f97532c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:46.981574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d988-828b-4363-aeb7-84528f97532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:47.047180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9295d988-828b-4363-aeb7-84528f97532c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:47.048398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9295d988-828b-4363-aeb7-84528f97532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:47.077442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:47.149738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:47.440107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43197e01-39e4-4543-9478-fd9017134c07 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:47.441666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-43197e01-39e4-4543-9478-fd9017134c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:47.556908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43197e01-39e4-4543-9478-fd9017134c07 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:47.595643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:47.642024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:47.642621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:47.642898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:47.643165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:47.644747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:47.753938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:47.755377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81441d6-b902-49b3-8c61-a02ffa58b634 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:47.776461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 733/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:50.003192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec74d0-a070-431d-8507-f51cf0e1f58d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:50.003796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec74d0-a070-431d-8507-f51cf0e1f58d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:50.003796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec74d0-a070-431d-8507-f51cf0e1f58d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:50.005103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:50.010992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562acce-518d-4534-8e6b-d2a6731a8bdc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:50.011422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562acce-518d-4534-8e6b-d2a6731a8bdc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:50.011700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562acce-518d-4534-8e6b-d2a6731a8bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:50.077918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9562acce-518d-4534-8e6b-d2a6731a8bdc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:50.079110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9562acce-518d-4534-8e6b-d2a6731a8bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:50.088547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:50.175273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:50.466297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec74d0-a070-431d-8507-f51cf0e1f58d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:50.467841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ccec74d0-a070-431d-8507-f51cf0e1f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:50.572828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec74d0-a070-431d-8507-f51cf0e1f58d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:50.628422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:50.646254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:50.646883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:50.647150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:50.647461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:50.649040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:50.755962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:50.757301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114ca47-99e7-4253-aeae-85cb2d553692 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:50.774665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 727/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:52.971277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1319f0-d9a7-4df2-8ae7-2fdd9a15aa97 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:52.971829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1319f0-d9a7-4df2-8ae7-2fdd9a15aa97 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:52.971829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1319f0-d9a7-4df2-8ae7-2fdd9a15aa97 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:52.973178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:52.979059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337dd0-9ef9-43e5-bd38-65bda48337c6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:52.979518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337dd0-9ef9-43e5-bd38-65bda48337c6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:52.979638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337dd0-9ef9-43e5-bd38-65bda48337c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:53.044555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ab337dd0-9ef9-43e5-bd38-65bda48337c6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:53.045784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ab337dd0-9ef9-43e5-bd38-65bda48337c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:53.083538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:53.141284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:39:53.422861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1319f0-d9a7-4df2-8ae7-2fdd9a15aa97 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:53.424435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7d1319f0-d9a7-4df2-8ae7-2fdd9a15aa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:53.533908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1319f0-d9a7-4df2-8ae7-2fdd9a15aa97 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:53.572837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:53.609369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:53.609969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:53.610239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:53.610506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:53.612110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:53.720800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:53.722317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7798638-ec59-46ba-9458-c9f4801a2259 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:53.741495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 736/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:55.965415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4224e-e2a1-412e-b9e3-e79008079a16 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:55.967399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4224e-e2a1-412e-b9e3-e79008079a16 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:55.967399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4224e-e2a1-412e-b9e3-e79008079a16 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:55.967399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:55.973395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746494-d8b8-448a-ab54-840e8d99f472 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:55.973805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746494-d8b8-448a-ab54-840e8d99f472 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:55.973938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746494-d8b8-448a-ab54-840e8d99f472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:56.039033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-31746494-d8b8-448a-ab54-840e8d99f472 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:56.040215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31746494-d8b8-448a-ab54-840e8d99f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:56.057550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:56.134383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:56.424025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4224e-e2a1-412e-b9e3-e79008079a16 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:56.425651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bac4224e-e2a1-412e-b9e3-e79008079a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:56.531857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4224e-e2a1-412e-b9e3-e79008079a16 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:56.598732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:56.605812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:56.606412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:56.606686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:56.606948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:56.608539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:56.716352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:56.717815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e82d12-e59d-446b-83eb-f1697ea766f9 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:56.736239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 730/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:39:58.942215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55692e-667c-4fda-9cf6-cad3f1af3a11 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:58.942754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55692e-667c-4fda-9cf6-cad3f1af3a11 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:58.942754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55692e-667c-4fda-9cf6-cad3f1af3a11 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:58.943998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:39:58.949625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a15dd-8729-4aea-aad0-ccd98c702da9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:58.950100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a15dd-8729-4aea-aad0-ccd98c702da9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:58.950248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a15dd-8729-4aea-aad0-ccd98c702da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:59.017018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-076a15dd-8729-4aea-aad0-ccd98c702da9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:39:59.018259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-076a15dd-8729-4aea-aad0-ccd98c702da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:59.066675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:59.119211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:39:59.405452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55692e-667c-4fda-9cf6-cad3f1af3a11 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:39:59.406969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7a55692e-667c-4fda-9cf6-cad3f1af3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:59.511336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55692e-667c-4fda-9cf6-cad3f1af3a11 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:39:59.559444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:39:59.585392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:39:59.586161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:39:59.586659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:39:59.586963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:39:59.588557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:39:59.701303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:39:59.702745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e48dc8-32d3-41ba-a3c7-09a26b1ce13c service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:39:59.721492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 739/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:09.116867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=22 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:09.719110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=66 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:19.816614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b665e-de8b-4b34-aac6-9f998cd37132 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:19.817186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b665e-de8b-4b34-aac6-9f998cd37132 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:19.817186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b665e-de8b-4b34-aac6-9f998cd37132 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:19.818420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 732/1471] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:19.823926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db24a-896f-4418-b3ef-4877c337d16c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:19.824379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db24a-896f-4418-b3ef-4877c337d16c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:19.824500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db24a-896f-4418-b3ef-4877c337d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:19.892655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-990db24a-896f-4418-b3ef-4877c337d16c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:19.893887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-990db24a-896f-4418-b3ef-4877c337d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:19.992789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 740/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:20.291890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852007-eb63-444f-8c2f-455c84ba0be2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:20.292168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852007-eb63-444f-8c2f-455c84ba0be2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:20.292440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de852007-eb63-444f-8c2f-455c84ba0be2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:20.293817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 733/1473] 10.222.0.64 () {54 vars in 966 bytes} [Fri Sep 9 11:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:20.298919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e1b6-816f-4ec3-ae02-c92a5e2fe60a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:20.299205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e1b6-816f-4ec3-ae02-c92a5e2fe60a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:20.299482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e1b6-816f-4ec3-ae02-c92a5e2fe60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:20.375544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4d71e1b6-816f-4ec3-ae02-c92a5e2fe60a None None] MFA Rules not processed for user `3f69a6b87a274ca3b4d658080992abb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:20.376749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4d71e1b6-816f-4ec3-ae02-c92a5e2fe60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:20.396859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:20.451818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 741/1474] 10.222.0.64 () {58 vars in 1063 bytes} [Fri Sep 9 11:40:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:20.459514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852007-eb63-444f-8c2f-455c84ba0be2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:20.461772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-de852007-eb63-444f-8c2f-455c84ba0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:20.564523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de852007-eb63-444f-8c2f-455c84ba0be2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:20.641518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:20.642119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:20.642390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:20.642653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:20.644236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:20.698900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:20.754152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:20.755575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f4706-995e-4c60-baaa-c6875982603d service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:20.775508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 734/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:23.064806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c327bb-765d-413e-bf35-90b619de81ef None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:23.065395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c327bb-765d-413e-bf35-90b619de81ef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:23.065395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c327bb-765d-413e-bf35-90b619de81ef None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:23.066739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 742/1476] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:23.072206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390231d5-d784-4042-be65-6ab9505af99c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:23.072641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390231d5-d784-4042-be65-6ab9505af99c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:23.072746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390231d5-d784-4042-be65-6ab9505af99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:23.138297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-390231d5-d784-4042-be65-6ab9505af99c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:23.139503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-390231d5-d784-4042-be65-6ab9505af99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:23.235090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 735/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:23.513080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c327bb-765d-413e-bf35-90b619de81ef None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:23.514646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-07c327bb-765d-413e-bf35-90b619de81ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:23.642396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c327bb-765d-413e-bf35-90b619de81ef None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:23.692429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:23.737835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:23.738432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:23.738711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:23.738979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:23.739606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:23.741416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:40:23.741416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:40:23.741416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:40:23.743289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0b97d-4f6a-44d1-b93e-07c6d78750fa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:23.762700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 743/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Fri Sep 9 11:40:23 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:40:25.939266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66777e5-1468-4134-97e2-5590d703bf00 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:25.939810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66777e5-1468-4134-97e2-5590d703bf00 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:25.939810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66777e5-1468-4134-97e2-5590d703bf00 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:25.941063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 736/1479] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:25.947134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a837f-0a3c-415d-b997-1c1eea46ff6e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:25.947556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a837f-0a3c-415d-b997-1c1eea46ff6e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:25.947680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a837f-0a3c-415d-b997-1c1eea46ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:26.014074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-166a837f-0a3c-415d-b997-1c1eea46ff6e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:26.015281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-166a837f-0a3c-415d-b997-1c1eea46ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:26.119162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 744/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:26.419729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66777e5-1468-4134-97e2-5590d703bf00 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:26.421361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a66777e5-1468-4134-97e2-5590d703bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:26.431608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:26.568830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66777e5-1468-4134-97e2-5590d703bf00 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:26.650197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:26.684313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:26.684839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:26.685108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:26.685405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:26.686985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:26.777167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:26.778772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13702317-00c2-47af-a212-be48f10a6d2e service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:26.796639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 737/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:29.154861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786865b-2672-4028-9101-e9df0430de35 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:29.155297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786865b-2672-4028-9101-e9df0430de35 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:29.155406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786865b-2672-4028-9101-e9df0430de35 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:29.156767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 745/1482] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:29.162160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592775-6848-4afb-86a5-b8d798da47b5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:29.162557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592775-6848-4afb-86a5-b8d798da47b5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:29.162756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592775-6848-4afb-86a5-b8d798da47b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:29.227998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c0592775-6848-4afb-86a5-b8d798da47b5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:29.229293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c0592775-6848-4afb-86a5-b8d798da47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:29.275120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:29.325379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 738/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:29.613476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786865b-2672-4028-9101-e9df0430de35 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:29.615037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f786865b-2672-4028-9101-e9df0430de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:29.643880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:29.730974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786865b-2672-4028-9101-e9df0430de35 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:29.821492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:29.822203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:29.822478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:29.822742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:29.824324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:29.901599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:29.936184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:29.937673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8578b1-d6bd-4390-bfd9-f35f83cf659d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:30.073710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 746/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:32.271274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebdd82-a21b-4128-9afe-84e171639ea4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:32.271855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebdd82-a21b-4128-9afe-84e171639ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:32.271855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebdd82-a21b-4128-9afe-84e171639ea4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:32.273142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 739/1485] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:32.279041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b15be1-7be0-46d0-b4ed-7950fed258bb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:32.279495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b15be1-7be0-46d0-b4ed-7950fed258bb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:32.279605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b15be1-7be0-46d0-b4ed-7950fed258bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:32.344061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c5b15be1-7be0-46d0-b4ed-7950fed258bb None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:32.345533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c5b15be1-7be0-46d0-b4ed-7950fed258bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:32.440477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 747/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:32.732298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebdd82-a21b-4128-9afe-84e171639ea4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:32.733871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfebdd82-a21b-4128-9afe-84e171639ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:32.838542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebdd82-a21b-4128-9afe-84e171639ea4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:32.914437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:32.916069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:32.916668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:32.916943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:32.917206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:32.918829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:33.027118 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:33.028545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c6a9c-5dfa-4e1a-a581-25b94589a03e service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:33.045953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 740/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:35.380564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c99b-24c2-4884-bf15-0309f4c03c6d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:35.381097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c99b-24c2-4884-bf15-0309f4c03c6d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:35.381247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c99b-24c2-4884-bf15-0309f4c03c6d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:35.382511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 748/1488] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:35.388945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db0e0-a586-4da1-aed1-50b9b2260951 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:35.389396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db0e0-a586-4da1-aed1-50b9b2260951 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:35.389502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db0e0-a586-4da1-aed1-50b9b2260951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:35.454898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-485db0e0-a586-4da1-aed1-50b9b2260951 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:35.456113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-485db0e0-a586-4da1-aed1-50b9b2260951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:35.508327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:35.551600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 741/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:35.842472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c99b-24c2-4884-bf15-0309f4c03c6d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:35.844029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-42b9c99b-24c2-4884-bf15-0309f4c03c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:35.882236 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:35.948471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c99b-24c2-4884-bf15-0309f4c03c6d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:36.022420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:36.023024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:36.023287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:36.023552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:36.025644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:36.107880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:36.135059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:36.136487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfabd0-5f73-4856-884b-e7b9e95867db service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:36.154539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 749/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:38.762210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c4d4-0ff6-4f03-850c-5e972d1d2120 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:38.763073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c4d4-0ff6-4f03-850c-5e972d1d2120 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:38.763073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9c4d4-0ff6-4f03-850c-5e972d1d2120 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:38.764629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 742/1491] 10.222.0.64 () {54 vars in 927 bytes} [Fri Sep 9 11:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:40:38.769852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12467b2-909b-4d18-be12-b808dec97304 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:38.770265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12467b2-909b-4d18-be12-b808dec97304 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:38.770368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12467b2-909b-4d18-be12-b808dec97304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:38.836392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e12467b2-909b-4d18-be12-b808dec97304 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:40:38.838769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e12467b2-909b-4d18-be12-b808dec97304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:38.939727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 750/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Fri Sep 9 11:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:40:39.230430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c4d4-0ff6-4f03-850c-5e972d1d2120 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:40:39.231962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3ea9c4d4-0ff6-4f03-850c-5e972d1d2120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:39.334850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9c4d4-0ff6-4f03-850c-5e972d1d2120 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:40:39.409199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:40:39.409820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:40:39.410091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:40:39.410350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:40:39.411929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:40:39.420978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:39.521256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:40:39.522779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db5e06-bf18-4624-9b76-794acf5432f3 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:40:39.542152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 743/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:40:48.941476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:40:49.539130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=50 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:01.987006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:01.987585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:01.987585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:02.063700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:42:02.064884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:02.158160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 751/1494] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:42:02.166623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:02.167126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:02.167231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:02.242192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:42:02.243337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:02.338950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 744/1495] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:42:02.343556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:02.344790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:02.357071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ab62e-8102-499b-ae93-1f8405dd6c01 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:02.418184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:02.451874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:02.452464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:02.452736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:02.453094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:02.453851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:42:02.454144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:02.455140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:02.455140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:42:02.455140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:42:02.456011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:02.468604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 752/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:42:02.477674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:02.486788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557097d-1d27-4ba8-8f5d-7a899e0f8308 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:02.547195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:02.580018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:02.580613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:02.580880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:02.581143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:02.581780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:02.583483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:02.583483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:42:02.583483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:42:02.584666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:02.732975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 745/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:42:02 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:42:02.737153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:02.738872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:02.772279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90d29-39ee-4c46-9fa1-48ec27a768ac admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:02.866213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:02.867336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:02.867598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:02.867864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:02.868491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:02.869537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:02.869537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:42:02.869537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:42:02.870755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:03.007274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 753/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:42:02 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:42:03.011636 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:03.014071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:03.075311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b154-95a4-41e1-a8bc-18e0cd986cee admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:03.159365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:03.170880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:03.171518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:03.171736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:03.171999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:03.172632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:03.173662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:03.173662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:42:03.173662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:42:03.174540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:03.188350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 746/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:42:03.192299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:03.193828 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:03.204974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79451b03-0854-4906-8e13-8f2385b72ea8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:03.230557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:03.300196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:03.300784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:03.301053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:03.301350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:03.301979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:03.302984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:03.302984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:42:03.302984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:42:03.303862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b293c9-ad27-4d89-9269-a4cce9a94c38 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:03.315803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 754/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:42:03.320954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:03.322560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:03.356880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ed78f-482f-4285-8fed-0b4ad5a85ffe admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:03.451305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:03.451976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:03.452246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:03.452512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] PATH_INFO: `/v3/projects/3a6b06a01d3f4703a1df126133f43efb/users/5e90a7a39f744cb9b555caee7a976f47/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:03.476262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6b06a01d3f4703a1df126133f43efb, user_id=5e90a7a39f744cb9b555caee7a976f47, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:03.477321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:03.477321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:42:03.477321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:42:03.479278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2406-81a0-4174-9a83-666aa7e39969 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:03.557599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 747/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:42:03 2022] PUT /identity/v3/projects/3a6b06a01d3f4703a1df126133f43efb/users/5e90a7a39f744cb9b555caee7a976f47/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:42:03.570446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c50943-6d48-4ab4-b30e-737a65bd96bf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:03.570723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c50943-6d48-4ab4-b30e-737a65bd96bf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:03.571473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c50943-6d48-4ab4-b30e-737a65bd96bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:03.628011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c7c50943-6d48-4ab4-b30e-737a65bd96bf None None] MFA Rules not processed for user `5e90a7a39f744cb9b555caee7a976f47`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:42:03.629232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c7c50943-6d48-4ab4-b30e-737a65bd96bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:03.705918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 755/1502] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:42:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:42:03.719579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e594-ef07-46de-b16b-ac350ca25078 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:03.719868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e594-ef07-46de-b16b-ac350ca25078 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:03.720142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e594-ef07-46de-b16b-ac350ca25078 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:03.721795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 748/1503] 10.222.0.64 () {54 vars in 964 bytes} [Fri Sep 9 11:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:42:03.727189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208144-4445-455b-99b9-d0f7b94b3cff None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:03.727472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208144-4445-455b-99b9-d0f7b94b3cff None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:03.727776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208144-4445-455b-99b9-d0f7b94b3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:03.758878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:03.807119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-40208144-4445-455b-99b9-d0f7b94b3cff None None] MFA Rules not processed for user `d02a5e02723a4c29ad8872f269138453`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:42:03.808327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-40208144-4445-455b-99b9-d0f7b94b3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:03.883982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 756/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Fri Sep 9 11:42:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:42:03.891921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e594-ef07-46de-b16b-ac350ca25078 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:03.893553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4cd8e594-ef07-46de-b16b-ac350ca25078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:03.942654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:03.995918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e594-ef07-46de-b16b-ac350ca25078 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:04.071122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:04.071719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:04.071993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:04.072259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:04.073888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:04.180760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:04.182246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:04.185714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:04.200600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 749/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:42:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:42:04.246110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6ddd-90ab-45d9-b17c-c9559f240227 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:04.246532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6ddd-90ab-45d9-b17c-c9559f240227 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:04.246637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec6ddd-90ab-45d9-b17c-c9559f240227 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:04.247852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 757/1506] 10.222.0.64 () {52 vars in 830 bytes} [Fri Sep 9 11:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:42:04.251356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:04.252550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:04.350438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f70b74-c968-4f2f-a370-9fc7353532cd service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:04.443975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:04.445406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:04.445686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:04.445953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] PATH_INFO: `/v3/users/5e90a7a39f744cb9b555caee7a976f47` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:04.458801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e90a7a39f744cb9b555caee7a976f47)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:04.459819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:04.459819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:42:04.459819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:42:04.461287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:04.471179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:04.680303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e90a7a39f744cb9b555caee7a976f47'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:04.680746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e90a7a39f744cb9b555caee7a976f47'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:04.681294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e90a7a39f744cb9b555caee7a976f47'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:04.695660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e90a7a39f744cb9b555caee7a976f47'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:04.789928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e90a7a39f744cb9b555caee7a976f47'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:04.818837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 750/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:42:04 2022] DELETE /identity/v3/users/5e90a7a39f744cb9b555caee7a976f47 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:42:04.824034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:04.824322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:04.824595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:04.880452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:42:04.881618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:04.956674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:04.969098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 758/1508] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:42:04.979446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:04.980674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:05.079906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ccd90-7e8c-462e-98a4-0ea055484022 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:05.135352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:05.154086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:05.154693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:05.154969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:05.155240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:05.156834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:05.267325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:05.270139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb83c5-7f3f-4fb8-8bda-6a9c1c09a589 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:05.293765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 751/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:42:05.770733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:42:05.772134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:42:05.783489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7015b22-9d54-41d1-bf82-df1e9375f7b9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:42:05.880857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:42:05.881509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:42:05.881782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:42:05.882081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] PATH_INFO: `/v3/projects/3a6b06a01d3f4703a1df126133f43efb` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:42:05.891811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6b06a01d3f4703a1df126133f43efb)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:42:05.893207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:42:05.893207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:42:05.893207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:42:05.894415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:42:06.029791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6b06a01d3f4703a1df126133f43efb', 'request_id': 'req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:06.133597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6b06a01d3f4703a1df126133f43efb', 'request_id': 'req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:06.140011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6b06a01d3f4703a1df126133f43efb', 'request_id': 'req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:06.171303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] The token cache is being invalidate because project 3a6b06a01d3f4703a1df126133f43efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:42:06.171584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:06.172015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13b2d85e-1d8f-4ac4-bfb4-8164555f3586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:42:06.173410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 759/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:42:05 2022] DELETE /identity/v3/projects/3a6b06a01d3f4703a1df126133f43efb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:42:15.291413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=62 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:42:16.169487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:43:43.758412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e71e-b43e-4d1d-be14-4491f6d413f0 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:43.759000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e71e-b43e-4d1d-be14-4491f6d413f0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:43.759000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e71e-b43e-4d1d-be14-4491f6d413f0 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:43.760414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:43:43.765296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28969d-71ff-4698-975d-96cf9e9ac556 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:43.765759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28969d-71ff-4698-975d-96cf9e9ac556 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:43.765861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28969d-71ff-4698-975d-96cf9e9ac556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:43.846691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cc28969d-71ff-4698-975d-96cf9e9ac556 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:43:43.848503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cc28969d-71ff-4698-975d-96cf9e9ac556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:43.950995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:43:44.106347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e71e-b43e-4d1d-be14-4491f6d413f0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:43:44.108509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76f1e71e-b43e-4d1d-be14-4491f6d413f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:44.228408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e71e-b43e-4d1d-be14-4491f6d413f0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:43:44.233726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fbe2d-5d1f-40ee-a6a1-c3083747fbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:43:44.234323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fbe2d-5d1f-40ee-a6a1-c3083747fbef service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:44.234593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fbe2d-5d1f-40ee-a6a1-c3083747fbef service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:44.234858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fbe2d-5d1f-40ee-a6a1-c3083747fbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:44.242798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fbe2d-5d1f-40ee-a6a1-c3083747fbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:43:44.244358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fbe2d-5d1f-40ee-a6a1-c3083747fbef service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:43:44.253500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 753/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:43:45.347886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac323e-c742-41b4-9ccd-301b8c8006eb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:45.348517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac323e-c742-41b4-9ccd-301b8c8006eb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:45.348517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac323e-c742-41b4-9ccd-301b8c8006eb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:45.349915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:43:45.356203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1ad36-a079-4962-b120-20ffa3c73363 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:45.356689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1ad36-a079-4962-b120-20ffa3c73363 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:45.356818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1ad36-a079-4962-b120-20ffa3c73363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:45.375817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-32a1ad36-a079-4962-b120-20ffa3c73363 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:43:45.377006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-32a1ad36-a079-4962-b120-20ffa3c73363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:45.385529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:43:45.540122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac323e-c742-41b4-9ccd-301b8c8006eb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:43:45.555182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac323e-c742-41b4-9ccd-301b8c8006eb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:43:45.560531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54cc42-dfa5-4d2a-8217-c4e52e50999f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:43:45.561117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54cc42-dfa5-4d2a-8217-c4e52e50999f service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:45.561426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54cc42-dfa5-4d2a-8217-c4e52e50999f service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:45.561701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54cc42-dfa5-4d2a-8217-c4e52e50999f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:45.570892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54cc42-dfa5-4d2a-8217-c4e52e50999f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:43:45.572583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54cc42-dfa5-4d2a-8217-c4e52e50999f service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:43:45.584283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 762/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:43:45.613012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49954f3a-4fbd-4720-b6d5-105a0d152ae9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:45.614090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49954f3a-4fbd-4720-b6d5-105a0d152ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:45.614380 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49954f3a-4fbd-4720-b6d5-105a0d152ae9 None None] PATH_INFO: `/v3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:45.616931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 755/1517] 10.222.0.65 () {54 vars in 925 bytes} [Fri Sep 9 11:43:45 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:43:45.623014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088643-661c-4ebf-a7a1-205a1a0f1006 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:45.623628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088643-661c-4ebf-a7a1-205a1a0f1006 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:45.625039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088643-661c-4ebf-a7a1-205a1a0f1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:45.701591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-95088643-661c-4ebf-a7a1-205a1a0f1006 None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:43:45.702826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-95088643-661c-4ebf-a7a1-205a1a0f1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:45.721237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:43:45.778282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 763/1518] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Sep 9 11:43:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:43:54.717600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0da2d3-07bd-4ae4-a595-8be8686c69ea None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:54.718077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0da2d3-07bd-4ae4-a595-8be8686c69ea None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:54.718186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0da2d3-07bd-4ae4-a595-8be8686c69ea None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:54.719452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 756/1519] 10.222.0.64 () {54 vars in 961 bytes} [Fri Sep 9 11:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:43:54.725434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04907202-7762-44f0-929e-a9f8b5e9032b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:54.728801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04907202-7762-44f0-929e-a9f8b5e9032b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:54.728801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04907202-7762-44f0-929e-a9f8b5e9032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:54.745297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-04907202-7762-44f0-929e-a9f8b5e9032b None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:43:54.746485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-04907202-7762-44f0-929e-a9f8b5e9032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:54.754932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 764/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Fri Sep 9 11:43:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:43:54.762609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0da2d3-07bd-4ae4-a595-8be8686c69ea None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:43:54.776376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0da2d3-07bd-4ae4-a595-8be8686c69ea None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:43:54.781233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedd5b8-a62d-4bf0-8ade-1b9e4c3c32b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:43:54.781818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd5b8-a62d-4bf0-8ade-1b9e4c3c32b6 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:54.782092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd5b8-a62d-4bf0-8ade-1b9e4c3c32b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:54.782360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd5b8-a62d-4bf0-8ade-1b9e4c3c32b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:54.791181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedd5b8-a62d-4bf0-8ade-1b9e4c3c32b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:43:54.792754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedd5b8-a62d-4bf0-8ade-1b9e4c3c32b6 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:43:54.802117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 757/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:43:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:43:57.074625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c96f7-b69c-4f7e-90c9-72e105cb447b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:57.075178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c96f7-b69c-4f7e-90c9-72e105cb447b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:57.075178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c96f7-b69c-4f7e-90c9-72e105cb447b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:57.076509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:43:57.082786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61719-0e5c-456c-b51f-cb10d577290f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:57.083240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61719-0e5c-456c-b51f-cb10d577290f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:57.083345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61719-0e5c-456c-b51f-cb10d577290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:57.102601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6ce61719-0e5c-456c-b51f-cb10d577290f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:43:57.103810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6ce61719-0e5c-456c-b51f-cb10d577290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:57.111474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:43:57.265004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c96f7-b69c-4f7e-90c9-72e105cb447b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:43:57.279353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c96f7-b69c-4f7e-90c9-72e105cb447b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:43:57.285490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb623d9-b553-4ea7-8ef9-76909e18067d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:43:57.286084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb623d9-b553-4ea7-8ef9-76909e18067d service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:57.286361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb623d9-b553-4ea7-8ef9-76909e18067d service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:57.286628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb623d9-b553-4ea7-8ef9-76909e18067d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:57.295040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb623d9-b553-4ea7-8ef9-76909e18067d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:43:57.296610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb623d9-b553-4ea7-8ef9-76909e18067d service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:43:57.306478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 766/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:43:58.393145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2ef6-9726-451d-bda0-10a6ad3038fa None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:58.393856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2ef6-9726-451d-bda0-10a6ad3038fa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:58.393856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc2ef6-9726-451d-bda0-10a6ad3038fa None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:58.395089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:43:58.401884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0742-4b01-4281-93d9-f560b9647452 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:58.410878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0742-4b01-4281-93d9-f560b9647452 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:58.410878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0742-4b01-4281-93d9-f560b9647452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:58.424142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-08ff0742-4b01-4281-93d9-f560b9647452 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:43:58.425930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-08ff0742-4b01-4281-93d9-f560b9647452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:43:58.434810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:43:58.587404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2ef6-9726-451d-bda0-10a6ad3038fa None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:43:58.602677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc2ef6-9726-451d-bda0-10a6ad3038fa None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:43:58.608049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4f32-3ac1-488d-bd27-c22e9aca3058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:43:58.608630 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4f32-3ac1-488d-bd27-c22e9aca3058 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:43:58.608902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4f32-3ac1-488d-bd27-c22e9aca3058 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:43:58.609163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4f32-3ac1-488d-bd27-c22e9aca3058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:43:58.618030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4f32-3ac1-488d-bd27-c22e9aca3058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:43:58.619649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4f32-3ac1-488d-bd27-c22e9aca3058 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:43:58.629662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 760/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:44:02.878404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133b59-0683-425f-ae28-055c734cb1f9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:02.878994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133b59-0683-425f-ae28-055c734cb1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:02.879231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133b59-0683-425f-ae28-055c734cb1f9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:02.880694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:44:02.886418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607925-3c1a-4c6c-9384-21309b483689 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:02.886899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607925-3c1a-4c6c-9384-21309b483689 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:02.887015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e607925-3c1a-4c6c-9384-21309b483689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:02.906543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0e607925-3c1a-4c6c-9384-21309b483689 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:44:02.907724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0e607925-3c1a-4c6c-9384-21309b483689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:02.915627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:44:03.213636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133b59-0683-425f-ae28-055c734cb1f9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:44:03.215320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-71133b59-0683-425f-ae28-055c734cb1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:03.293040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133b59-0683-425f-ae28-055c734cb1f9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:44:03.296593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16469c08-d159-4f7e-b0f6-56fdbfd4f9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:44:03.297191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16469c08-d159-4f7e-b0f6-56fdbfd4f9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:03.297583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16469c08-d159-4f7e-b0f6-56fdbfd4f9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:03.297835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16469c08-d159-4f7e-b0f6-56fdbfd4f9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:03.306892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16469c08-d159-4f7e-b0f6-56fdbfd4f9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:44:03.308315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16469c08-d159-4f7e-b0f6-56fdbfd4f9b6 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:44:03.318208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 769/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:44:05.484958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eceb4-0245-472f-b5e9-64e476d1db70 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:05.485511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eceb4-0245-472f-b5e9-64e476d1db70 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:05.485511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eceb4-0245-472f-b5e9-64e476d1db70 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:05.486885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:44:05.493179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1938df6-c9f5-435f-bea6-aebc81157bb7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:05.493609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1938df6-c9f5-435f-bea6-aebc81157bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:05.493725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1938df6-c9f5-435f-bea6-aebc81157bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:05.514223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c1938df6-c9f5-435f-bea6-aebc81157bb7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:44:05.515417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c1938df6-c9f5-435f-bea6-aebc81157bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:05.523409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:44:05.819053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eceb4-0245-472f-b5e9-64e476d1db70 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:44:05.820751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b19eceb4-0245-472f-b5e9-64e476d1db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:05.828191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=75 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:44:05.834908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eceb4-0245-472f-b5e9-64e476d1db70 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:44:05.838987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbc51e-5911-4ae1-a50e-eb8d5172147e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:44:05.839155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc51e-5911-4ae1-a50e-eb8d5172147e service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:05.839305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc51e-5911-4ae1-a50e-eb8d5172147e service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:05.839574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbc51e-5911-4ae1-a50e-eb8d5172147e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:05.848854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbc51e-5911-4ae1-a50e-eb8d5172147e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:44:05.850379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbc51e-5911-4ae1-a50e-eb8d5172147e service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:44:05.859711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 763/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:44:09.579560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1f884-c177-41a0-b656-f51100897e74 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:09.580114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1f884-c177-41a0-b656-f51100897e74 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:09.580114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1f884-c177-41a0-b656-f51100897e74 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:09.581776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:44:09.587293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840555-1e25-4bea-a888-c350f254762d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:09.587714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840555-1e25-4bea-a888-c350f254762d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:09.593089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840555-1e25-4bea-a888-c350f254762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:09.607885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-30840555-1e25-4bea-a888-c350f254762d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:44:09.609074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-30840555-1e25-4bea-a888-c350f254762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:09.619133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:44:09.922667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1f884-c177-41a0-b656-f51100897e74 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:44:09.924390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2af1f884-c177-41a0-b656-f51100897e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:09.989972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:44:10.003013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1f884-c177-41a0-b656-f51100897e74 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:44:10.006625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa622b-fdc8-473a-9312-87c161036fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:44:10.007221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa622b-fdc8-473a-9312-87c161036fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:10.007499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa622b-fdc8-473a-9312-87c161036fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:10.007768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa622b-fdc8-473a-9312-87c161036fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:10.016576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa622b-fdc8-473a-9312-87c161036fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:44:10.018064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa622b-fdc8-473a-9312-87c161036fd2 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:44:10.028302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 772/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:44:12.179394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7159b-ab76-4c8b-bc1f-0f7e2ed1c89e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:12.180004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7159b-ab76-4c8b-bc1f-0f7e2ed1c89e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:12.180004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7159b-ab76-4c8b-bc1f-0f7e2ed1c89e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:12.181371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:44:12.186738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714f09-a5a1-4edc-bdc2-79b59cf0c266 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:12.187179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714f09-a5a1-4edc-bdc2-79b59cf0c266 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:12.187287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714f09-a5a1-4edc-bdc2-79b59cf0c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:12.206855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d7714f09-a5a1-4edc-bdc2-79b59cf0c266 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:44:12.210029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d7714f09-a5a1-4edc-bdc2-79b59cf0c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:12.215682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:44:12.548478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7159b-ab76-4c8b-bc1f-0f7e2ed1c89e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:44:12.550465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1ce7159b-ab76-4c8b-bc1f-0f7e2ed1c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:44:12.563321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7159b-ab76-4c8b-bc1f-0f7e2ed1c89e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:44:12.567307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4dbc8-c171-43d9-a074-492a79a74efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:44:12.567918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4dbc8-c171-43d9-a074-492a79a74efc service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:44:12.568190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4dbc8-c171-43d9-a074-492a79a74efc service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:44:12.568455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4dbc8-c171-43d9-a074-492a79a74efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:44:12.577073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4dbc8-c171-43d9-a074-492a79a74efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:44:12.578514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4dbc8-c171-43d9-a074-492a79a74efc service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:44:12.588710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 766/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:44:22.201461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=11 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:44:22.584634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=14 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:40.066643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131832-a373-4f53-b429-652fd1f6798a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.075365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131832-a373-4f53-b429-652fd1f6798a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.075365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131832-a373-4f53-b429-652fd1f6798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.113581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e2131832-a373-4f53-b429-652fd1f6798a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.116075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e2131832-a373-4f53-b429-652fd1f6798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.141707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 774/1540] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:40.159077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.159986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.159986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.161918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02cfe4-6618-458c-a63b-5737f0408e9a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.162724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02cfe4-6618-458c-a63b-5737f0408e9a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.163532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02cfe4-6618-458c-a63b-5737f0408e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.211691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.213820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.221792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ec02cfe4-6618-458c-a63b-5737f0408e9a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.223830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec02cfe4-6618-458c-a63b-5737f0408e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.248249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 767/1541] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:40.256932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 775/1542] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:45:40.262256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:40.280481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2256d8-fb3b-4402-ab54-19ee01f19f2f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:40.286511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.286797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.287097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.299575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:40.309694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.310061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.310408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.311098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:40.312716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:40.313772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:45:40.313772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:45:40.313772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:45:40.315305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:40.331574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.332720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.352852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 768/1543] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:40.360084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 776/1544] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:45:40.362225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:40.372179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:40.380929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82203346-1fd5-4ab0-b3ec-10e1c845f8f9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:40.388686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52674-9885-4b50-b060-e5af9d8410ec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:40.390093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:40.390740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.391023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.391296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.391962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:40.394964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:40.407288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:40.407976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.408703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.409287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.409953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:40.410257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:40.411886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:40.449648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 777/1545] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:45:40.460249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:40.480976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452a89-edba-4107-98d4-f8626c66b286 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:40.490839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:40.491468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.491749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.492019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.492657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:40.493740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:45:40.493740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:45:40.493740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:45:40.494977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:40.576450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 769/1546] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:40.581289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:40.621333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 778/1547] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:40.621565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:40.702147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1203f4-1f3a-4575-98ec-0832badddf05 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:40.760065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a82351-e6ea-42c5-8829-3cb75e22676a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:40.773277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b28a-e178-4fd6-921a-0577baf0f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:40.773954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b28a-e178-4fd6-921a-0577baf0f650 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.774237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b28a-e178-4fd6-921a-0577baf0f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.774510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b28a-e178-4fd6-921a-0577baf0f650 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.775147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b28a-e178-4fd6-921a-0577baf0f650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:40.781596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b28a-e178-4fd6-921a-0577baf0f650 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:40.804201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:40.805394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.805898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.806390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.807436 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:40.808682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:45:40.808682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:45:40.808682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:45:40.812457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5ef8e-bed7-4c8c-8057-3b8d350a965a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:40.897134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 779/1548] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:45:40.898673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45576cfa-0847-448a-9191-cef5e8980368 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.899019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45576cfa-0847-448a-9191-cef5e8980368 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.899361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45576cfa-0847-448a-9191-cef5e8980368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.919368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-45576cfa-0847-448a-9191-cef5e8980368 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.920550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-45576cfa-0847-448a-9191-cef5e8980368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.928870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 780/1549] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:40.930072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6406b-2386-40ed-9aaf-0c67bfb4fe9b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.930355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6406b-2386-40ed-9aaf-0c67bfb4fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.930661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6406b-2386-40ed-9aaf-0c67bfb4fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.950588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a1c6406b-2386-40ed-9aaf-0c67bfb4fe9b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.952140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a1c6406b-2386-40ed-9aaf-0c67bfb4fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.960091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 770/1550] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/users => generated 289 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:40.960091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c2ef-5318-44bf-b347-e46dec1bce5a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.960091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c2ef-5318-44bf-b347-e46dec1bce5a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.960091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2c2ef-5318-44bf-b347-e46dec1bce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.962150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 781/1551] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:40.969928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.970317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.970599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.979971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cae2c2ef-5318-44bf-b347-e46dec1bce5a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:40.981281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cae2c2ef-5318-44bf-b347-e46dec1bce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:40.989532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 771/1552] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:40.990848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51146e40-63db-49b2-8fec-847f92696051 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:40.991132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51146e40-63db-49b2-8fec-847f92696051 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:40.991402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51146e40-63db-49b2-8fec-847f92696051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:40.997782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.002163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.008081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 782/1553] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.008878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.012346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-51146e40-63db-49b2-8fec-847f92696051 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.013721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-51146e40-63db-49b2-8fec-847f92696051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.019638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055b9d-e1ad-4f18-b7c5-a3af6481dd51 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.022459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 772/1554] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.023796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.024074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.024323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ae930-9702-44fc-ac7f-2363b04a9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.024450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.024916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ae930-9702-44fc-ac7f-2363b04a9ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.025235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ae930-9702-44fc-ac7f-2363b04a9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.025499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ae930-9702-44fc-ac7f-2363b04a9ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.026139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ae930-9702-44fc-ac7f-2363b04a9ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.027733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ae930-9702-44fc-ac7f-2363b04a9ca9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.039846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 783/1555] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:41.041496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d0bb6-b846-4052-84a8-4fc8d569afd0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.041824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d0bb6-b846-4052-84a8-4fc8d569afd0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.042099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d0bb6-b846-4052-84a8-4fc8d569afd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.046797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.048025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.057448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 773/1556] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.058245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.061940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-da8d0bb6-b846-4052-84a8-4fc8d569afd0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.063304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da8d0bb6-b846-4052-84a8-4fc8d569afd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.068829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538a70-7f7e-4931-909e-b273cccc5b72 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.072380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 784/1557] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.073534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1665d-1907-4c94-9d58-6e0d38df19c5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.073832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1665d-1907-4c94-9d58-6e0d38df19c5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.074091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1665d-1907-4c94-9d58-6e0d38df19c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.074397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06379-f339-442b-9e64-975155edc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.075041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06379-f339-442b-9e64-975155edc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.075366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06379-f339-442b-9e64-975155edc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.075746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06379-f339-442b-9e64-975155edc1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.076515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c06379-f339-442b-9e64-975155edc1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.078126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c06379-f339-442b-9e64-975155edc1f8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.093746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 774/1558] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:41.093746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112957-4e40-4a82-ac8d-c1d065eaa3dd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.093746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112957-4e40-4a82-ac8d-c1d065eaa3dd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.093746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112957-4e40-4a82-ac8d-c1d065eaa3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.095545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-42f1665d-1907-4c94-9d58-6e0d38df19c5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.097111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-42f1665d-1907-4c94-9d58-6e0d38df19c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.105039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 785/1559] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.106255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.106543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.106813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.114878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-05112957-4e40-4a82-ac8d-c1d065eaa3dd None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.116091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-05112957-4e40-4a82-ac8d-c1d065eaa3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.124152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 775/1560] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.128185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6931-a968-42e5-a3d1-0fbbfaf158a7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.128185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6931-a968-42e5-a3d1-0fbbfaf158a7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.128185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6931-a968-42e5-a3d1-0fbbfaf158a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.128431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.128431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.135375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 786/1561] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.136152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.146106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431666f8-c2a0-4fd7-bc73-79912fd55722 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.146608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e09a6931-a968-42e5-a3d1-0fbbfaf158a7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.147846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e09a6931-a968-42e5-a3d1-0fbbfaf158a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.151067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.151650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.151928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.152195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.152816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.154523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.155907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 776/1562] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.157297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.157584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.157932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.166296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:41.167184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 787/1563] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:41.167992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.177995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3bb5f-4f87-4dab-8e96-c51ec960c6a2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.182412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.182569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.183145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.183424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.183592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:41.183704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.184311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:41.184610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.186302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.191953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 777/1564] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:41.192934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.199042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 788/1565] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:41.200010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.205924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe8fb-f744-4767-b4ba-ac7ccba3ab8d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.210532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9774cd8-33de-4974-b429-0c4a2c63e7c7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.213594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.213594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.213594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.213594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.214001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.214391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.215175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.215759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.216032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.216302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.216958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:41.217345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.218962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.230596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 778/1566] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:41.230596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.231663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 789/1567] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:41.232460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.241335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bcc8-c967-41dd-b1b1-1302cd90bd4e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.242304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415dc9a-cc91-42cf-9606-eca521cfe411 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.246271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.246933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.247087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.247458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.247589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.247738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.247855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.248129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.248376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:41.248677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.248773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:41.249038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.250320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.250759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.252464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:41.262600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 779/1568] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:41.271221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.271420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 790/1569] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:41.271420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.274794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f1a5-8e66-488a-8f90-52d277021ba9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.279101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0a0a-f9e5-4022-8557-74fcc8675ac1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.279530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.280181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.280457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.280726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] PATH_INFO: `/v3/projects/4a17c4018eb644b3b766e698e66bf1bd/users/da74c6076b204ddeab14f9f2c171264a/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.284146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.284768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.285049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.285363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.286030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:41.286330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.287956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.297468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a17c4018eb644b3b766e698e66bf1bd, user_id=da74c6076b204ddeab14f9f2c171264a, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.299512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:45:41.299512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:45:41.299512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:45:41.301755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.309079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 780/1570] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:41.309079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.312605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34debb-ea7b-4143-b2df-7111ede70810 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.318013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.318596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.318874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.319141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.319772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:41.320070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.321774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.333820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 781/1571] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:41.334573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.344220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a11a5-fb99-4fcb-82d3-d87ce9e94a80 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.349189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.349802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.350075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.350339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.350942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.352789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.382793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 791/1572] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:41 2022] PUT /identity/v3/projects/4a17c4018eb644b3b766e698e66bf1bd/users/da74c6076b204ddeab14f9f2c171264a/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:41.383807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.444433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931888-0506-4d35-8eb2-33e3d073dbda admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.449012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.449698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.449972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.450236 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] PATH_INFO: `/v3/projects/9ff6925154714c7fa1136aeeced7fb70/users/0a1b019c66e3439a8eb18890e1f05bcd/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.464371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff6925154714c7fa1136aeeced7fb70, user_id=0a1b019c66e3439a8eb18890e1f05bcd, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.467473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.468437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 782/1573] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:41.469358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.533726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9471df-a2f4-4e3a-b51e-8093f13b467d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.538317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.538906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.539180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.539441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.540104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.542126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.564126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 792/1574] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:41 2022] PUT /identity/v3/projects/9ff6925154714c7fa1136aeeced7fb70/users/0a1b019c66e3439a8eb18890e1f05bcd/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:41.568540 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.631151 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971338-ca28-4b95-83d4-17186fcfdeeb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.635922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.636525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.636808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.637085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.637743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.639665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.646411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 783/1575] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:41.646411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.706974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8524-2adb-4a61-82c3-378df2060e36 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.711531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.712117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.712388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.712653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.713298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.715283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.730092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:41.743352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 793/1576] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:41.744168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.785009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:41.805817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8b97-c5f6-4921-aefb-a64a4885da55 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.808663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 784/1577] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:41.809381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:41.813476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d6e83-9041-4bbb-972f-1de19648d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.814142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6e83-9041-4bbb-972f-1de19648d9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.814416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6e83-9041-4bbb-972f-1de19648d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.814752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6e83-9041-4bbb-972f-1de19648d9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.815510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6e83-9041-4bbb-972f-1de19648d9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.817520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6e83-9041-4bbb-972f-1de19648d9a1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.872433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5eaff-4117-4667-a8c1-aa6d07ef377e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:41.877358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:41.877955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.878235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.878509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.879165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:41.881075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:41.934333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 794/1578] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:41.935714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880c0a-2453-46df-bdb3-75bae090a588 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:41.936004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880c0a-2453-46df-bdb3-75bae090a588 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:41.936276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880c0a-2453-46df-bdb3-75bae090a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:41.956261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a5880c0a-2453-46df-bdb3-75bae090a588 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:41.958310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a5880c0a-2453-46df-bdb3-75bae090a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:42.001128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 785/1579] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.001128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.016152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 795/1580] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:42.018816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.018816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.018816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.039789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:42.041259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:42.064588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef61b-e40b-497e-873b-370b5d61bab1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.069522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.070142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.070405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.070703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.071334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.073317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.101107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 796/1581] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:42.102166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.111720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a760ac3-9593-4255-9bb1-d6dd79ac5443 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.116230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.116808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.117085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.117385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.118004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.119919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.179181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 786/1582] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:41 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.180137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.189985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6a55-cdf9-4bb7-a876-d0addfc9379b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.194727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.195291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.195564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.195833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.196438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.198523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.216177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 797/1583] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:42 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.216177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.224936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ee7c0-251c-4258-aadd-b7036879bf7c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.229707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.230298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.230574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.230840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.231451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.233433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.306032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 787/1584] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:42 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.306844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.316507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724add-5736-4af6-a36d-e80fd9463d9e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.321133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.321749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.322021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.322287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.322895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.324789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.342539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 798/1585] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:42 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.343339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.354291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea6366-345f-4cd3-9d84-14fe08535fe3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.358898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.359466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.359746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.360017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.360664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.363403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.433673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 788/1586] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:42 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.434658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.462855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 799/1587] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:42 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:42.465053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.472176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:42.480964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:42.492821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada24c0-2109-4943-9552-db494ca79fc4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.496532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.497133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.497438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.497740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.507031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.508458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.517980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 789/1588] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:42.518937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.524104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39217619-3edc-4a08-8c26-1070f70752b3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.528065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.528647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.528907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a615a8-4022-41b8-ad54-a1b0b596628e service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.529064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.529462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.535533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.536134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.536410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.536681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.537349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.538977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.541056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.542629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.549861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 790/1589] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.550803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.554736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 800/1590] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:42.555510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.561821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4adf3-a747-498b-888d-b2b20d82470c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.565419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067888a-c008-4c85-a34d-ebd678950d70 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.567099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.567814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.572788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.572788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.572788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.572788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.573304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.573304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.573304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.573304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.573684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.575285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.584548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 791/1591] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.585497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.589679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 801/1592] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.589679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.596157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8853c-6bde-4d6d-ac7f-a44868a3bf76 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.604012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39446c7f-a73a-424e-ae93-db064b1a4fc1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.604189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.604189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.604189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.604189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.604566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.604664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.604765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.605103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.605412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.605679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.606307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.607880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.616042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 792/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.616965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.621605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 802/1594] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.621605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.629440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5c7d2-2b08-4c9a-b4c9-ca780ad37950 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.633261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf7ee1-8728-484a-84fe-483703337285 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.634478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.635132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.635411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.635828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.636466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.638105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.641948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.641948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.641948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.641948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.642618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.642618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.651969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 793/1595] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.651969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.656050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 803/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.656050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.660677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61cdd6-4d5f-4056-8919-1483cdececd8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.666316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.666922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.667220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.667485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.667793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28063cb-6d23-4aa2-a40d-99234f8f5623 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.668116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.669721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.673988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.674893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.675454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.675900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.676848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.678729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.694114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 804/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.694114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.694428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 794/1598] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.695488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.712274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1a57-fa12-4f35-872d-edd78e00caee admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.717804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.720297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.720297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.720297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.720297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.721447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e626-2d0e-4113-8f26-e8a80ce021bb admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.722619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.728545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.730170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.730458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.730734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.731501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.733361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.738800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 805/1599] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.738800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.746176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 795/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.747272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.748485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218cf09-97f8-46f2-9867-279cd70a00e4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.755482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.756202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.756582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.756954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.757757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.758906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5942-e7a8-4ba2-9133-93405abe5178 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.759563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.764440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.765282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.765415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.765664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] PATH_INFO: `/v3/projects/0b282e64596f4ef8b8993f5dfcf37932/users/61ed413fdfab427287e7355612a795b3/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.772030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 806/1601] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:42.772735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.782048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b282e64596f4ef8b8993f5dfcf37932, user_id=61ed413fdfab427287e7355612a795b3, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.787927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.788070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7b335-605e-4d93-a88d-33faba6e132b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:42.792924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:42.793631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:42.793912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:42.794182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] PATH_INFO: `/v3/projects/35d538ca05a345b599bc99efa9c9fdfa/users/17b17921d1794fd282a3b0ed8e599180/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:42.809464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d538ca05a345b599bc99efa9c9fdfa, user_id=17b17921d1794fd282a3b0ed8e599180, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:42.812172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:42.894765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 796/1602] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:42 2022] PUT /identity/v3/projects/0b282e64596f4ef8b8993f5dfcf37932/users/61ed413fdfab427287e7355612a795b3/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:42.895689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:42.943643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 807/1603] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:42 2022] PUT /identity/v3/projects/35d538ca05a345b599bc99efa9c9fdfa/users/17b17921d1794fd282a3b0ed8e599180/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:42.944360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.015234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915043-0e9c-445a-bffb-7f5ffa21c754 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.043075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00bae-ff43-4156-b099-31f8512d1e73 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.047840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.048766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.049093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.049456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] PATH_INFO: `/v3/projects/3b511ef1e3824f72a8d053674dc9ff8a/users/d42a50c654514d3aad5974a9841d6b41/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.063496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:43.064816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b511ef1e3824f72a8d053674dc9ff8a, user_id=d42a50c654514d3aad5974a9841d6b41, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.067597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.074338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.075125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.075397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.075661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] PATH_INFO: `/v3/projects/06ef6423a8f0492a97951c8cee660142/users/ae6a6f4b47fb40c789aa62c894a89de9/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.090993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ef6423a8f0492a97951c8cee660142, user_id=ae6a6f4b47fb40c789aa62c894a89de9, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.093861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.179821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 808/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:42 2022] PUT /identity/v3/projects/3b511ef1e3824f72a8d053674dc9ff8a/users/d42a50c654514d3aad5974a9841d6b41/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:43.193832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.203263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:43.234763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 797/1605] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:42 2022] PUT /identity/v3/projects/06ef6423a8f0492a97951c8cee660142/users/ae6a6f4b47fb40c789aa62c894a89de9/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:43.235611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.288998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1af7-bb31-4e70-b7aa-57f1e2375c2e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.310796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464de6d-c5e4-48b1-ae3c-c0f44733e64b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.316561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac177-ce8e-4b3a-8e42-481a2eba8bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.317530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac177-ce8e-4b3a-8e42-481a2eba8bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.317804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac177-ce8e-4b3a-8e42-481a2eba8bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.318073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac177-ce8e-4b3a-8e42-481a2eba8bc1 admin admin] PATH_INFO: `/v3/projects/0eeaad89472d465aac7ffc3ebe7c6b29/users/25aa1cfa72db4e789990a0015da397d4/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.333546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aac177-ce8e-4b3a-8e42-481a2eba8bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eeaad89472d465aac7ffc3ebe7c6b29, user_id=25aa1cfa72db4e789990a0015da397d4, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.336336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aac177-ce8e-4b3a-8e42-481a2eba8bc1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.349257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b589d9-1c8e-478c-b679-0f638bf8da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.349855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b589d9-1c8e-478c-b679-0f638bf8da13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.350174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b589d9-1c8e-478c-b679-0f638bf8da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.354978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b589d9-1c8e-478c-b679-0f638bf8da13 admin admin] PATH_INFO: `/v3/projects/d374c56641724f7890861f8f3cb505cf/users/4880b94232c74cf493cc13b5ea6423a3/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.365815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b589d9-1c8e-478c-b679-0f638bf8da13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d374c56641724f7890861f8f3cb505cf, user_id=4880b94232c74cf493cc13b5ea6423a3, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.368495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b589d9-1c8e-478c-b679-0f638bf8da13 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.470583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 798/1606] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:43 2022] PUT /identity/v3/projects/0eeaad89472d465aac7ffc3ebe7c6b29/users/25aa1cfa72db4e789990a0015da397d4/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:43.471835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8254d1-e45e-4f5e-b600-620c1a3f31fa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.472107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8254d1-e45e-4f5e-b600-620c1a3f31fa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.472429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8254d1-e45e-4f5e-b600-620c1a3f31fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.491439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ea8254d1-e45e-4f5e-b600-620c1a3f31fa None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:43.492542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ea8254d1-e45e-4f5e-b600-620c1a3f31fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:43.516106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 809/1607] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:43 2022] PUT /identity/v3/projects/d374c56641724f7890861f8f3cb505cf/users/4880b94232c74cf493cc13b5ea6423a3/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:43.516106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481299bf-07b5-490f-9589-8c15eb98d969 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.517917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481299bf-07b5-490f-9589-8c15eb98d969 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.518343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481299bf-07b5-490f-9589-8c15eb98d969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.547974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-481299bf-07b5-490f-9589-8c15eb98d969 None None] MFA Rules not processed for user `17b17921d1794fd282a3b0ed8e599180`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:43.550183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-481299bf-07b5-490f-9589-8c15eb98d969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:43.575032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 799/1608] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:43.576321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b40ce-a443-4dd5-ba25-accca14e404b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.576659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b40ce-a443-4dd5-ba25-accca14e404b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.577088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b40ce-a443-4dd5-ba25-accca14e404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.611600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-dc4b40ce-a443-4dd5-ba25-accca14e404b None None] MFA Rules not processed for user `d42a50c654514d3aad5974a9841d6b41`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:43.613246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dc4b40ce-a443-4dd5-ba25-accca14e404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:43.646244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 810/1609] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:43.647699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e222f-0489-4823-acbe-fa59259d9c79 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.647811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e222f-0489-4823-acbe-fa59259d9c79 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.648008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e222f-0489-4823-acbe-fa59259d9c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.675833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:43.683353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6d0e222f-0489-4823-acbe-fa59259d9c79 None None] MFA Rules not processed for user `ae6a6f4b47fb40c789aa62c894a89de9`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:43.684877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6d0e222f-0489-4823-acbe-fa59259d9c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:43.700102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 800/1610] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:43.702325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.702622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.702946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.714102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:43.726809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:43.727884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:43.785539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 811/1611] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:43.785539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.785539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.785539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.811268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 801/1612] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:43.819928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] MFA Rules not processed for user `4880b94232c74cf493cc13b5ea6423a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:43.821365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:43.823334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.884333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33da5d-1b30-4577-9b63-811637c12e0b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.889727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a300-bdcb-4376-85c9-4c8d01313a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.890545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 812/1613] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:43.890669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a300-bdcb-4376-85c9-4c8d01313a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.891625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.894997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a300-bdcb-4376-85c9-4c8d01313a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.895353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a300-bdcb-4376-85c9-4c8d01313a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.903649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a034ba7-caa3-4751-b90b-e941db645148 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.906080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0a300-bdcb-4376-85c9-4c8d01313a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.908028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0a300-bdcb-4376-85c9-4c8d01313a99 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.908800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb3e2f-00c5-4a7e-a258-7c13973a1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.909427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb3e2f-00c5-4a7e-a258-7c13973a1ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.909700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb3e2f-00c5-4a7e-a258-7c13973a1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.910390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb3e2f-00c5-4a7e-a258-7c13973a1ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.910582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb3e2f-00c5-4a7e-a258-7c13973a1ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.912486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb3e2f-00c5-4a7e-a258-7c13973a1ad1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.920139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 802/1614] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:43.928052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f2f2-4aa0-456a-a693-2ab0f9c48b70 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.928477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f2f2-4aa0-456a-a693-2ab0f9c48b70 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.928955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f2f2-4aa0-456a-a693-2ab0f9c48b70 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.939809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 803/1615] 10.222.0.64 () {54 vars in 962 bytes} [Fri Sep 9 11:45:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:45:43.939809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef3952-a8dc-4059-9eb5-f9237a935d44 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.939809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef3952-a8dc-4059-9eb5-f9237a935d44 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.939809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef3952-a8dc-4059-9eb5-f9237a935d44 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.939809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 804/1616] 10.222.0.64 () {54 vars in 962 bytes} [Fri Sep 9 11:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:45:43.939809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef3952-a8dc-4059-9eb5-f9237a935d44 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.949789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef3952-a8dc-4059-9eb5-f9237a935d44 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.953617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.954200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.954471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.954779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.964671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.966441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:43.977646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 805/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:43.978756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:43.990553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8beb45-bad1-474a-b046-8ea8edcb8742 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:43.995789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08bf4b-7c74-4c52-8eb1-9c237d776884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:43.996051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08bf4b-7c74-4c52-8eb1-9c237d776884 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:43.996401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08bf4b-7c74-4c52-8eb1-9c237d776884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:43.996765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08bf4b-7c74-4c52-8eb1-9c237d776884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:43.997492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08bf4b-7c74-4c52-8eb1-9c237d776884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:43.999508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08bf4b-7c74-4c52-8eb1-9c237d776884 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.050076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 813/1618] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:44.051384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.051672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.052048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.091558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:44.092807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:44.140596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 806/1619] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:43 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:44.145831 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.146120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.146394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.166553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 814/1620] 10.222.0.64 () {58 vars in 1059 bytes} [Fri Sep 9 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:44.167099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:44.167400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.168366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:44.238009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e6747-fb09-4671-8ef0-37e1475961ff None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.242197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 807/1621] 10.222.0.64 () {58 vars in 1059 bytes} [Fri Sep 9 11:45:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:44.243013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.302499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.302499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.302499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.302499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.303129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.304367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.310634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a875e-2110-495c-bf04-56c5b94ea913 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.316846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.317577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.317923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.318274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.318973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.331919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.424865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 815/1622] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:44 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:44.426287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.438464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 808/1623] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:44 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:44.439944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.468195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81736257-e96e-4776-9616-d14cf02061b0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.474728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce052b4-597b-497e-9eaf-779a0be60757 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.479088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.480106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.480534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.480922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.483003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.483688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.483967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.484241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.583475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.585089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.585766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.587824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.596599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 809/1624] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:44.610015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.635396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 816/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:44.635577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.637758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955686d2-000b-4fde-9f11-f4df6725ae4c service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.642882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.643495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.643769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.644045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.644678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.646308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.661728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277ad27-f9f4-40b0-b62e-67e736c329a9 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.671191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 810/1626] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:44.672347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.674083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.676002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.679890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.680437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.681336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.683229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.696825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41041b-92a3-49be-89b5-b0254ecb4162 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.703106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.703583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.703859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.704130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] PATH_INFO: `/v3/projects/1879b36efdd64c3599dd3430a108de9b/users/21f5d1bb82c845b9ad0e1253b7ae49d5/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.727003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 817/1627] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:44.733539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.738517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1879b36efdd64c3599dd3430a108de9b, user_id=21f5d1bb82c845b9ad0e1253b7ae49d5, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.751155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.763460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9e3b-9768-43d3-a47c-5bf64cc48cde admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:44.781279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d82223-b227-4f5b-998e-d1440bccb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:44.782102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d82223-b227-4f5b-998e-d1440bccb3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.783388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d82223-b227-4f5b-998e-d1440bccb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.783759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d82223-b227-4f5b-998e-d1440bccb3ff admin admin] PATH_INFO: `/v3/projects/080339901d74477fa2524b1764c4941e/users/cdc78022d03d4efdb1fd197e6b16dd0e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.836894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d82223-b227-4f5b-998e-d1440bccb3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=080339901d74477fa2524b1764c4941e, user_id=cdc78022d03d4efdb1fd197e6b16dd0e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:44.840987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d82223-b227-4f5b-998e-d1440bccb3ff admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:44.873249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 811/1628] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:44 2022] PUT /identity/v3/projects/1879b36efdd64c3599dd3430a108de9b/users/21f5d1bb82c845b9ad0e1253b7ae49d5/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:45:44.877345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:44.980115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 818/1629] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:44 2022] PUT /identity/v3/projects/080339901d74477fa2524b1764c4941e/users/cdc78022d03d4efdb1fd197e6b16dd0e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:44.981666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d98f1-3103-4d77-9e0b-c63336331c1f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:44.982056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d98f1-3103-4d77-9e0b-c63336331c1f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:44.982778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d98f1-3103-4d77-9e0b-c63336331c1f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:44.986488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 819/1630] 10.222.0.64 () {54 vars in 912 bytes} [Fri Sep 9 11:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:45:44.987953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d98f1-3103-4d77-9e0b-c63336331c1f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:45.005164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f8c51-0c70-41a5-ac43-f59e1c977bad admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:45.039011 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:45.110167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:45.121034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d98f1-3103-4d77-9e0b-c63336331c1f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:45.124782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f4f4-eb0c-43f4-a9b1-2c52639c9166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:45.125435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f4f4-eb0c-43f4-a9b1-2c52639c9166 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.125710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f4f4-eb0c-43f4-a9b1-2c52639c9166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.125977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f4f4-eb0c-43f4-a9b1-2c52639c9166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.127911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1f4f4-eb0c-43f4-a9b1-2c52639c9166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:45.129809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1f4f4-eb0c-43f4-a9b1-2c52639c9166 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:45.133300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90b63-b7c9-4806-9b17-bf7555fa1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:45.134082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90b63-b7c9-4806-9b17-bf7555fa1d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.134371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90b63-b7c9-4806-9b17-bf7555fa1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.134644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90b63-b7c9-4806-9b17-bf7555fa1d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.136652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff90b63-b7c9-4806-9b17-bf7555fa1d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:45.139597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff90b63-b7c9-4806-9b17-bf7555fa1d4a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:45.143228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 812/1631] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:45:45.144525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875c560-ee5e-4695-9da9-d751e168541b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.144807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875c560-ee5e-4695-9da9-d751e168541b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.145073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875c560-ee5e-4695-9da9-d751e168541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.160197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 820/1632] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:45.161767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364f00-3cd7-4450-9913-3e74bb526798 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.162339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364f00-3cd7-4450-9913-3e74bb526798 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.162625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364f00-3cd7-4450-9913-3e74bb526798 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.164422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 821/1633] 10.222.0.64 () {54 vars in 912 bytes} [Fri Sep 9 11:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:45:45.164957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d364f00-3cd7-4450-9913-3e74bb526798 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:45.177771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5875c560-ee5e-4695-9da9-d751e168541b None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:45.179154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5875c560-ee5e-4695-9da9-d751e168541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:45.180781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d364f00-3cd7-4450-9913-3e74bb526798 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:45.186444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:45.187604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.187888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.188332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] PATH_INFO: `/v3/projects/1879b36efdd64c3599dd3430a108de9b/users/21f5d1bb82c845b9ad0e1253b7ae49d5/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.190967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1879b36efdd64c3599dd3430a108de9b, user_id=21f5d1bb82c845b9ad0e1253b7ae49d5, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:45.195146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:45.216803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 822/1634] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:45 2022] PUT /identity/v3/projects/1879b36efdd64c3599dd3430a108de9b/users/21f5d1bb82c845b9ad0e1253b7ae49d5/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:45.218146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:45.264564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 813/1635] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:45.278849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf16f9c-d890-4d0e-b261-15bc3d08bc31 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.279186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf16f9c-d890-4d0e-b261-15bc3d08bc31 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.280320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf16f9c-d890-4d0e-b261-15bc3d08bc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.319591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535040c-8179-4809-91e4-2bde0d0d6453 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:45.324656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c3494-4f33-4135-9189-3c557d964d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:45.325499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c3494-4f33-4135-9189-3c557d964d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.325776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c3494-4f33-4135-9189-3c557d964d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.326047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c3494-4f33-4135-9189-3c557d964d59 admin admin] PATH_INFO: `/v3/projects/080339901d74477fa2524b1764c4941e/users/cdc78022d03d4efdb1fd197e6b16dd0e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.326787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7cf16f9c-d890-4d0e-b261-15bc3d08bc31 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:45.328076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c3494-4f33-4135-9189-3c557d964d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080339901d74477fa2524b1764c4941e, user_id=cdc78022d03d4efdb1fd197e6b16dd0e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:45.329978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7cf16f9c-d890-4d0e-b261-15bc3d08bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:45.331917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c3494-4f33-4135-9189-3c557d964d59 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:45.346276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 823/1636] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:45 2022] PUT /identity/v3/projects/080339901d74477fa2524b1764c4941e/users/cdc78022d03d4efdb1fd197e6b16dd0e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:45.347633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.347926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.348199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.610152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] MFA Rules not processed for user `21f5d1bb82c845b9ad0e1253b7ae49d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:45.610152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:45.610152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 824/1637] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:45.610152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:45.613897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 814/1638] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:45.613897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.613897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.613897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.613897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] MFA Rules not processed for user `cdc78022d03d4efdb1fd197e6b16dd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:45.613897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:45.614739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993885a4-1edd-43f0-9786-cd410bd30298 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:45.614739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:45.614739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.614739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.615926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.719598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:45.722584 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:45.737791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 825/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:45.739107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:45.749034 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d25860-ee43-4cee-8ded-6cfc7bd15d64 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:45.756552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:45.757458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:45.757859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:45.758270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:45.770846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:45.771127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 815/1640] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:45.774544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:45.788245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 826/1641] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:45.995187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:46.013946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b184d-d474-4744-b3d7-c8c00577bc50 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:46.023165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:46.024305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:46.025936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:46.034586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:46.047794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:46.050306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:46.071081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 816/1642] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:46.735839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:46.815957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:47.220248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:47.229140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec116311-0b86-4599-aff9-d38783910111 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:47.236986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:47.237752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:47.238245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:47.238613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:47.255159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:47.259524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:47.275164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 827/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:48.097175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:48.107335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4ce7e-fcba-49b6-893a-c37dedc9afff service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:48.120633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b4e3b-60cb-44aa-b75a-30b0c9c34660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:48.121718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4e3b-60cb-44aa-b75a-30b0c9c34660 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:48.122149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4e3b-60cb-44aa-b75a-30b0c9c34660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:48.122522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4e3b-60cb-44aa-b75a-30b0c9c34660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:48.292253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b4e3b-60cb-44aa-b75a-30b0c9c34660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:48.296963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b4e3b-60cb-44aa-b75a-30b0c9c34660 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:48.325023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 817/1644] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:48.434845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:48.502074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:51.720035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:51.886189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81adaf-9bf8-48ad-b730-d57f315d0b56 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:51.899317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:51.900459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:51.902484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:51.902873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] PATH_INFO: `/v3/users/d42a50c654514d3aad5974a9841d6b41` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:51.906555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42a50c654514d3aad5974a9841d6b41)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:51.908544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:45:51.908544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: warnings.warn(msg) Sep 09 11:45:51.908544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: Sep 09 11:45:51.911702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:52.042814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:52.276489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42a50c654514d3aad5974a9841d6b41'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:52.277194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42a50c654514d3aad5974a9841d6b41'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:52.426979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42a50c654514d3aad5974a9841d6b41'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:52.455627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42a50c654514d3aad5974a9841d6b41'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:52.459340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42a50c654514d3aad5974a9841d6b41'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:52.545831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 828/1645] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:45:51 2022] DELETE /identity/v3/users/d42a50c654514d3aad5974a9841d6b41 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:52.550769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:52.551746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:52.552192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:52.573119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:52.574620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:52.709360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 818/1646] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:45:52.826775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:52.828780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:53.043253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eb013-4807-4520-83d2-7d0d56728d6a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:53.051095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6799-3ee9-4f36-b39f-e8aad45fd648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:53.056080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6799-3ee9-4f36-b39f-e8aad45fd648 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:53.056509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6799-3ee9-4f36-b39f-e8aad45fd648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:53.057039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6799-3ee9-4f36-b39f-e8aad45fd648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:53.083438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e6799-3ee9-4f36-b39f-e8aad45fd648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:53.086705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e6799-3ee9-4f36-b39f-e8aad45fd648 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:53.112833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 829/1647] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:55.017621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:55.017621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:55.033679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5e84d-eee0-43e7-b767-9ba1814ee32c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:55.049151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:55.049833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:55.050166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:55.050446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] PATH_INFO: `/v3/users/17b17921d1794fd282a3b0ed8e599180` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:55.051723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b17921d1794fd282a3b0ed8e599180)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:55.053644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:55.101993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:55.327896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:55.331466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:55.331466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:55.374314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b17921d1794fd282a3b0ed8e599180'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:55.375342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b17921d1794fd282a3b0ed8e599180'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:55.377168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b17921d1794fd282a3b0ed8e599180'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:55.389302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b17921d1794fd282a3b0ed8e599180'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:55.412870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] MFA Rules not processed for user `0a1b019c66e3439a8eb18890e1f05bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:55.414319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:55.524191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5e251c9a-3211-4311-a88c-8964e0bde40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b17921d1794fd282a3b0ed8e599180'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:55.562867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 819/1648] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:45:55 2022] DELETE /identity/v3/users/17b17921d1794fd282a3b0ed8e599180 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:55.565325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:55.565966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:55.566807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:55.619872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 830/1649] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:55.628306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:55.633003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:55.639941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:55.641701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:55.708562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:55.778781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 820/1650] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:55.796714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:55.799555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:55.817071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba487ed7-f15a-44b8-964d-9ca8531a9dcc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:55.835119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cef44c-d44d-4413-aabe-472dc6bca129 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:55.855926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:55.857019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:55.857518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:55.858046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] PATH_INFO: `/v3/projects/3b511ef1e3824f72a8d053674dc9ff8a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:55.867545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b511ef1e3824f72a8d053674dc9ff8a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:55.869811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: WARNING py.warnings [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:45:55.869811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: warnings.warn(msg) Sep 09 11:45:55.869811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: Sep 09 11:45:55.876715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:55.957061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:55.957967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:55.958538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:55.958964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.119729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b511ef1e3824f72a8d053674dc9ff8a', 'request_id': 'req-8e6cd43b-3c6c-4398-918b-37547b89650e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:56.159995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:56.163264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:56.174122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b511ef1e3824f72a8d053674dc9ff8a', 'request_id': 'req-8e6cd43b-3c6c-4398-918b-37547b89650e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:56.182238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 831/1651] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:45:56.184515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:56.186758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:56.269790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b511ef1e3824f72a8d053674dc9ff8a', 'request_id': 'req-8e6cd43b-3c6c-4398-918b-37547b89650e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:56.318153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] The token cache is being invalidate because project 3b511ef1e3824f72a8d053674dc9ff8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:45:56.331187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:56.331187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8e6cd43b-3c6c-4398-918b-37547b89650e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:56.331187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 821/1652] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:45:55 2022] DELETE /identity/v3/projects/3b511ef1e3824f72a8d053674dc9ff8a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:56.331187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef64d-bfdf-427f-aeaa-ce200a905267 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:56.331187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef64d-bfdf-427f-aeaa-ce200a905267 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:56.331187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef64d-bfdf-427f-aeaa-ce200a905267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.349008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47415-25a8-4c8c-8deb-988875a9caaa service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:56.378321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2a0ef64d-bfdf-427f-aeaa-ce200a905267 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:56.381114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2a0ef64d-bfdf-427f-aeaa-ce200a905267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:56.518348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:56.519010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:56.519270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:56.519542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.523227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:56.577946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 822/1653] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:56.590812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:56.591205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:56.591632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.699161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:56.707585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:56.744406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 823/1654] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:45:56.750204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:56.761854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:56.774628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:56.791822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 832/1655] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:56.792615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:56.793972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:56.797749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f541b9-0a9c-4c73-ab78-d8fe28d88b18 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:56.827920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c79b6-e9e9-45e8-aa8b-5a0b4c9b2493 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:56.828082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:56.828905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:56.829242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:56.829505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.830369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:45:56.830670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:56.839759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:56.839937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:56.840422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:56.840701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:56.840975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] PATH_INFO: `/v3/users/ae6a6f4b47fb40c789aa62c894a89de9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.853359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6a6f4b47fb40c789aa62c894a89de9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:56.860922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:56.884938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 824/1656] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:45:56.886487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:56.905394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd30c5-8e8e-4b5d-ba17-b3d7a2fc4f00 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:56.914836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261eebf-1e66-4954-948d-41989dded5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:56.915512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261eebf-1e66-4954-948d-41989dded5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:56.915794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261eebf-1e66-4954-948d-41989dded5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:56.916070 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261eebf-1e66-4954-948d-41989dded5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:56.919891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261eebf-1e66-4954-948d-41989dded5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:56.927018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261eebf-1e66-4954-948d-41989dded5a0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:56.957458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:57.125862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 825/1657] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:45:56 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:45:57.129134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:57.129635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:57.130950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:57.208560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] MFA Rules not processed for user `25aa1cfa72db4e789990a0015da397d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:57.210729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:57.216533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6a6f4b47fb40c789aa62c894a89de9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:57.222352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6a6f4b47fb40c789aa62c894a89de9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:57.380498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 826/1658] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:57.381572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:57.524599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6a6f4b47fb40c789aa62c894a89de9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:57.536495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6a6f4b47fb40c789aa62c894a89de9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:57.539986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85dfda29-2e47-4710-b80e-d4f3cdd8ff2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6a6f4b47fb40c789aa62c894a89de9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:57.601006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 833/1659] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:45:56 2022] DELETE /identity/v3/users/ae6a6f4b47fb40c789aa62c894a89de9 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:57.602417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc857-1a16-4752-9082-776675de1668 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:57.602822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc857-1a16-4752-9082-776675de1668 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:57.603266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc857-1a16-4752-9082-776675de1668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:57.616296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6552-66ed-4d99-a2c5-9d7ddcecd254 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:57.658945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fe4fc857-1a16-4752-9082-776675de1668 None None] MFA Rules not processed for user `25aa1cfa72db4e789990a0015da397d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:57.670124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe4fc857-1a16-4752-9082-776675de1668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:57.825869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 834/1660] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:57.828496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:57.829591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:57.830044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:57.871415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:57.877390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:57.877390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:57.877390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:57.877925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:57.879980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:57.896841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:57.898375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:57.931254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 835/1661] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:57.932546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:57.933947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:58.049585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 827/1662] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:45:57 2022] POST /identity/v3/users => generated 288 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:45:58.053691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:58.060776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:58.209682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482708a1-2957-46aa-9aaa-4267802c7f54 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:58.227642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:58.228265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.228555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.228922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.239421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:58.268905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:58.270977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:58.310841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 836/1663] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:58.320105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:58.322942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:58.341612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129438-ecb7-49c7-b6d9-8d0267b1b41b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:58.366721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:58.367634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.368264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.368741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.372365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f0df-873c-4195-b2e6-d134a6d7e08a service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:58.397178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:58.397667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:58.398357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.398636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.398948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.399600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:58.400210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:58.404669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:58.432799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 828/1664] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:58.435353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:58.437773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:58.446438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 837/1665] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:58.453416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:58.483860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50403-9b1d-4214-9307-405fe51b9dce service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:58.489358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08d4f-aba5-4d0a-8f93-872f8088635f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:58.497946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:58.499151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.501477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.501920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] PATH_INFO: `/v3/projects/35d538ca05a345b599bc99efa9c9fdfa` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.503409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:58.505592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d538ca05a345b599bc99efa9c9fdfa)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:58.508203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:58.513147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:58.513147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.513147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.517183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.517779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:58.523903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:58.550786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 838/1666] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:45:58.556979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:58.582473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99005-d2bb-4e83-8860-65ff4ba749bd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:58.598658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab1f9f-13be-4e73-b974-9230e2d8ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:58.598658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab1f9f-13be-4e73-b974-9230e2d8ffef admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.604060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab1f9f-13be-4e73-b974-9230e2d8ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.604060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab1f9f-13be-4e73-b974-9230e2d8ffef admin admin] PATH_INFO: `/v3/projects/04d0ad9d342741eeb79db586249eaefb/users/f5d9f9ad54614b35bc5e1d90834f1bd1/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.664613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab1f9f-13be-4e73-b974-9230e2d8ffef admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d0ad9d342741eeb79db586249eaefb, user_id=f5d9f9ad54614b35bc5e1d90834f1bd1, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:58.675407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab1f9f-13be-4e73-b974-9230e2d8ffef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:58.799404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 839/1667] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:45:58 2022] PUT /identity/v3/projects/04d0ad9d342741eeb79db586249eaefb/users/f5d9f9ad54614b35bc5e1d90834f1bd1/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:45:58.810931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:58.811206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:58.811412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:58.836291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d538ca05a345b599bc99efa9c9fdfa', 'request_id': 'req-b9816fca-3b92-40c5-a49d-add7150b9f2a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:58.854732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d538ca05a345b599bc99efa9c9fdfa', 'request_id': 'req-b9816fca-3b92-40c5-a49d-add7150b9f2a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:58.879202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] MFA Rules not processed for user `f5d9f9ad54614b35bc5e1d90834f1bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:58.880452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:58.975515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d538ca05a345b599bc99efa9c9fdfa', 'request_id': 'req-b9816fca-3b92-40c5-a49d-add7150b9f2a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:58.997551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] The token cache is being invalidate because project 35d538ca05a345b599bc99efa9c9fdfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:45:58.997848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:58.998515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b9816fca-3b92-40c5-a49d-add7150b9f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:59.005752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 829/1668] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:45:58 2022] DELETE /identity/v3/projects/35d538ca05a345b599bc99efa9c9fdfa => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:59.008809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:59.009105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:59.009412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:59.015631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 840/1669] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:59.016591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:59.082714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] MFA Rules not processed for user `da74c6076b204ddeab14f9f2c171264a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:59.084004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:59.212953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a066d-f39f-4ace-9cca-af7a8028d50a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:59.243064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 830/1670] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:59.243280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:59.243382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:59.243464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:59.243464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:59.243464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] PATH_INFO: `/v3/users/21f5d1bb82c845b9ad0e1253b7ae49d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:59.243464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f5d1bb82c845b9ad0e1253b7ae49d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:59.243708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:59.243776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:59.463476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25bb5e-e816-4f40-8dba-7dc992f5a63d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:45:59.477340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:45:59.479255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:59.479255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:59.479255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:59.486570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:59.510949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:45:59.512642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbb186-0ba0-414e-af92-c2673744f438 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:45:59.549947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 831/1671] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:45:59.552437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8675ce-1380-4446-bb9f-4079e4fc4c26 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:59.552728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8675ce-1380-4446-bb9f-4079e4fc4c26 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:59.553000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8675ce-1380-4446-bb9f-4079e4fc4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:59.607572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1f8675ce-1380-4446-bb9f-4079e4fc4c26 None None] MFA Rules not processed for user `da74c6076b204ddeab14f9f2c171264a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:59.620301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1f8675ce-1380-4446-bb9f-4079e4fc4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:59.630319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:45:59.634127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f5d1bb82c845b9ad0e1253b7ae49d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:59.635222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f5d1bb82c845b9ad0e1253b7ae49d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:59.645427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 832/1672] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:45:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:59.660673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f5eb0-82d1-4588-a2b5-ce9382d47a3f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:59.660673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f5eb0-82d1-4588-a2b5-ce9382d47a3f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:59.660673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f5eb0-82d1-4588-a2b5-ce9382d47a3f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:59.672104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 833/1673] 10.222.0.64 () {54 vars in 912 bytes} [Fri Sep 9 11:45:59 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:45:59.682180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:45:59.682180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:45:59.682537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:45:59.746488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f5d1bb82c845b9ad0e1253b7ae49d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:59.764021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f5d1bb82c845b9ad0e1253b7ae49d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:59.764021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f5d1bb82c845b9ad0e1253b7ae49d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:45:59.796379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:45:59.802310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:59.811687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 841/1674] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:45:59 2022] DELETE /identity/v3/users/21f5d1bb82c845b9ad0e1253b7ae49d5 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:45:59.818133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:45:59.821171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:45:59.983359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 834/1675] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:45:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:45:59.996980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:00.004787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:00.020674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c27e2-e31b-4418-b183-522b20e4b8fd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:00.051942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281ea42-3746-4ded-a0b7-91ce6f0bfc93 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:00.060052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:00.060863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:00.061265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:00.061614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:00.064408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:00.116657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:00.117203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:00.117562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:00.118007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:00.132738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:00.135788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:00.153516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 835/1676] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:00.154760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:00.156583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:00.166797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 842/1677] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:45:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:00.244350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:00.552550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:00.553962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:00.764712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d1e3-b007-4632-b86b-88b5c6a210fc service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:00.774101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:00.804597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:00.804597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:00.804597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] PATH_INFO: `/v3/projects/06ef6423a8f0492a97951c8cee660142` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:00.804597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ef6423a8f0492a97951c8cee660142)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:00.804597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:01.090012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ef6423a8f0492a97951c8cee660142', 'request_id': 'req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:01.125142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ef6423a8f0492a97951c8cee660142', 'request_id': 'req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:01.280012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ef6423a8f0492a97951c8cee660142', 'request_id': 'req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:01.311972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:01.314075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:01.325088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] The token cache is being invalidate because project 06ef6423a8f0492a97951c8cee660142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:01.325360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:01.334067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7ac0a81-94b7-4e07-8039-3a2a470ab70e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:01.344322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 836/1678] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:00 2022] DELETE /identity/v3/projects/06ef6423a8f0492a97951c8cee660142 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:01.350338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40be99-1fd6-40ee-88f3-59ab1f6f0156 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:01.351306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40be99-1fd6-40ee-88f3-59ab1f6f0156 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:01.351767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40be99-1fd6-40ee-88f3-59ab1f6f0156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:01.458987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cd40be99-1fd6-40ee-88f3-59ab1f6f0156 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:01.464679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cd40be99-1fd6-40ee-88f3-59ab1f6f0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:01.578169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374c7e-f8f1-4a14-bf26-afcd4e9592a6 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:01.666771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 837/1679] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:01.674328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e12f8-98b3-46f1-8b5b-4289b71bbc11 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:01.675052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e12f8-98b3-46f1-8b5b-4289b71bbc11 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:01.675359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e12f8-98b3-46f1-8b5b-4289b71bbc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:01.788832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-212e12f8-98b3-46f1-8b5b-4289b71bbc11 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:01.797074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-212e12f8-98b3-46f1-8b5b-4289b71bbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:01.815688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 838/1680] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:01.817181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:01.817849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:01.818196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:01.823328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:01.823965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:01.824242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:01.824513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:01.835486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:01.841148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] MFA Rules not processed for user `25aa1cfa72db4e789990a0015da397d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:01.844247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:01.876756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:01.878444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:01.931700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 843/1681] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:01.932835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:01.936188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 839/1682] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:01.968533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81b57-a9a2-4f0a-a30e-e7435c40aeed service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:01.978005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:01.978890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:01.979178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:01.979455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:01.980110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:01.980413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:01.982090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:02.007436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 844/1683] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:02.012174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:02.032422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc2a05-dc18-4de6-b088-6860ca60e4e5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:02.053883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:02.055825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:02.070878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:02.071656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.072039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.072413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.073167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:02.075230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:02.079028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e34b4-54d6-45dc-b271-56cceeb07479 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:02.091453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:02.092337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.092776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.093192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] PATH_INFO: `/v3/users/f5d9f9ad54614b35bc5e1d90834f1bd1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.096209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d9f9ad54614b35bc5e1d90834f1bd1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:02.099298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:02.264934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 840/1684] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:02 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:02.273717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:02.275805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:02.280285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:02.445920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e6d0-7bfb-4795-b09f-a6ca2b934b2d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:02.456549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d9f9ad54614b35bc5e1d90834f1bd1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.460305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d9f9ad54614b35bc5e1d90834f1bd1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.462757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:02.463471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.463697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.463969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] PATH_INFO: `/v3/projects/1879b36efdd64c3599dd3430a108de9b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.468669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1879b36efdd64c3599dd3430a108de9b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:02.471039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:02.557830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d9f9ad54614b35bc5e1d90834f1bd1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.567670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d9f9ad54614b35bc5e1d90834f1bd1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.568721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-350a344e-1bc1-43da-ba8f-99719c95ea10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d9f9ad54614b35bc5e1d90834f1bd1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.617601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 845/1685] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:02 2022] DELETE /identity/v3/users/f5d9f9ad54614b35bc5e1d90834f1bd1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:02.619787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040b90-f175-47ea-9c86-9b01b3c8520d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.622097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040b90-f175-47ea-9c86-9b01b3c8520d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.622645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040b90-f175-47ea-9c86-9b01b3c8520d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.636625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 846/1686] 10.222.0.64 () {54 vars in 912 bytes} [Fri Sep 9 11:46:02 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:46:02.638370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d040b90-f175-47ea-9c86-9b01b3c8520d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:02.640824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d040b90-f175-47ea-9c86-9b01b3c8520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:02.690620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1879b36efdd64c3599dd3430a108de9b', 'request_id': 'req-403b21dc-5815-4867-b4df-122d0580742c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.722282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1879b36efdd64c3599dd3430a108de9b', 'request_id': 'req-403b21dc-5815-4867-b4df-122d0580742c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.732647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d040b90-f175-47ea-9c86-9b01b3c8520d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:02.735240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:02.744127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18275bec-4c1c-4c5f-a724-2da881922bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:02.744127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18275bec-4c1c-4c5f-a724-2da881922bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.744127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18275bec-4c1c-4c5f-a724-2da881922bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.744127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18275bec-4c1c-4c5f-a724-2da881922bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.744478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18275bec-4c1c-4c5f-a724-2da881922bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:02.746105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18275bec-4c1c-4c5f-a724-2da881922bb2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:02.878150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1879b36efdd64c3599dd3430a108de9b', 'request_id': 'req-403b21dc-5815-4867-b4df-122d0580742c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.898104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 847/1687] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:02 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:02.898213 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] The token cache is being invalidate because project 1879b36efdd64c3599dd3430a108de9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:02.898213 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.898357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c7867-720c-40d3-9c6f-a66854269b6f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.898357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c7867-720c-40d3-9c6f-a66854269b6f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.898498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-403b21dc-5815-4867-b4df-122d0580742c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:02.898571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c7867-720c-40d3-9c6f-a66854269b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.898643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 841/1688] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:02 2022] DELETE /identity/v3/projects/1879b36efdd64c3599dd3430a108de9b => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:02.905707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883bfe6-ad72-4328-ac6a-875cd8bdc500 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:02.905707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883bfe6-ad72-4328-ac6a-875cd8bdc500 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:02.905707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883bfe6-ad72-4328-ac6a-875cd8bdc500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:02.965201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1883bfe6-ad72-4328-ac6a-875cd8bdc500 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:02.968448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1883bfe6-ad72-4328-ac6a-875cd8bdc500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:02.999362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 842/1689] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:03.002642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.005648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.010790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.018153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ae9c7867-720c-40d3-9c6f-a66854269b6f None None] MFA Rules not processed for user `61ed413fdfab427287e7355612a795b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:03.020823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ae9c7867-720c-40d3-9c6f-a66854269b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:03.080059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:03.085560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:03.145570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 848/1690] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:03.146779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.147070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.147345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.177736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 843/1691] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:03.188390 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.189625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:03.190388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:03.190978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:03.209748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 849/1692] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:03.209748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.209748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:03.214483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea81ade-d715-4a56-bdc7-3f12c1669bf0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.220724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40013412-53d8-4882-8be4-f4df6eb84a69 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.223508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.231290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.231290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.231290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.231290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.231753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6ba5-dae2-4220-950a-677de9b6cda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.231753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6ba5-dae2-4220-950a-677de9b6cda2 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.231753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6ba5-dae2-4220-950a-677de9b6cda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.231753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6ba5-dae2-4220-950a-677de9b6cda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.232022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:03.240331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6ba5-dae2-4220-950a-677de9b6cda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.241932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6ba5-dae2-4220-950a-677de9b6cda2 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:03.246122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 844/1693] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:03.247155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.260610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 850/1694] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:03.262840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fac8e5-04ec-4557-9355-04e7603b7324 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.263203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.264078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.264466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.267677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.268291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.268801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.269514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.279405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.281038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:03.292126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:03.293976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:03.294774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 845/1695] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:03.295807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.304901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 851/1696] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:03.309315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.314826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bc9cd-4891-4d53-802c-22a33ec24106 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.321393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.322197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.322655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.323086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.324671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.327947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:03.330724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a338e8-55ad-4eb6-a808-37d2dff653a1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.343955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.347477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 846/1697] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:03.350280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.351875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.352205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.352645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.355498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:03.357287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.364613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:03.388161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dca24-856c-4093-9cb2-08fd8f6ccfe7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.405650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.411965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 852/1698] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:46:03.412616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.413157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.414513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:03.416376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] PATH_INFO: `/v3/projects/d25630338a2741b2942e8f1557de9d58/users/ca8d85b7f94641659129b722f6f5f29f/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.443939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb5aa-d987-4105-956b-35355fcc53ac admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:03.460328 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12893d8-3d9f-44c7-9bae-a6e61142ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:03.460966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12893d8-3d9f-44c7-9bae-a6e61142ff9b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:03.461196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12893d8-3d9f-44c7-9bae-a6e61142ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:03.461499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12893d8-3d9f-44c7-9bae-a6e61142ff9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:03.463452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12893d8-3d9f-44c7-9bae-a6e61142ff9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.466898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25630338a2741b2942e8f1557de9d58, user_id=ca8d85b7f94641659129b722f6f5f29f, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:03.471861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12893d8-3d9f-44c7-9bae-a6e61142ff9b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:03.474303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:04.001400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 847/1699] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:03 2022] PUT /identity/v3/projects/d25630338a2741b2942e8f1557de9d58/users/ca8d85b7f94641659129b722f6f5f29f/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:04.003181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 853/1700] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:03 2022] POST /identity/v3/projects => generated 387 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:04.012670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:04.012963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:04.013262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:04.024291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:04.086139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] MFA Rules not processed for user `ca8d85b7f94641659129b722f6f5f29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:04.087394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:04.315210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e67180-ff5d-44ee-86bf-351e3a084501 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:04.391996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 854/1701] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:04.409760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:04.419015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:04.546837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:04.547798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:04.551561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:04.551849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:04.552540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:04.554541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:04.715009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 848/1702] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:04 2022] POST /identity/v3/users => generated 294 bytes in 706 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:04.716189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:04.718756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:04.773199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155681e6-a425-4af5-8783-5a505afe1513 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:04.807747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:04.809512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:04.811596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:04.811596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:04.967747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dab11f-85e7-4f31-acaa-3664911c4e81 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:04.968291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:04.973161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:04.990115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:04.990943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:04.991236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:04.991624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:04.993664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 855/1703] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:04.996763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:05.001381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:05.033031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:05.037504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:05.049193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463745c6-b1f3-4a91-b3f1-ceb13d29714c service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:05.061774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:05.062627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.063928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.066889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] PATH_INFO: `/v3/projects/04d0ad9d342741eeb79db586249eaefb` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:05.069956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d0ad9d342741eeb79db586249eaefb)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:05.072664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:05.110908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 849/1704] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:05.116376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:05.148491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1411c1-f4c7-4b75-b876-6fc5e8a0a71a service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:05.163914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:05.167258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:05.175658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.184404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.187506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:05.190046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:05.195356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:05.230522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 850/1705] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:05.232771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:05.259318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65022ed6-8c01-4759-8c65-2e013d021162 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:05.274274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:05.275747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.276034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.276311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:05.276963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:05.279145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:05.318754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 851/1706] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:05.320092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:05.336175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b787f-1884-4190-a43f-964499b5834e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:05.347541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab776dc-0129-4037-ac9b-ddbd43a91bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:05.348472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab776dc-0129-4037-ac9b-ddbd43a91bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.348786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab776dc-0129-4037-ac9b-ddbd43a91bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.349066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab776dc-0129-4037-ac9b-ddbd43a91bbc admin admin] PATH_INFO: `/v3/projects/3776d31746df4538a761c241f4708054/users/8b06fb96cb7448098c64f05b88ff2db1/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:05.371601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab776dc-0129-4037-ac9b-ddbd43a91bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3776d31746df4538a761c241f4708054, user_id=8b06fb96cb7448098c64f05b88ff2db1, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:05.376659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab776dc-0129-4037-ac9b-ddbd43a91bbc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:05.527811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 852/1707] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:05 2022] PUT /identity/v3/projects/3776d31746df4538a761c241f4708054/users/8b06fb96cb7448098c64f05b88ff2db1/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:05.539962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.540247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.540520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:05.554032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d0ad9d342741eeb79db586249eaefb', 'request_id': 'req-3ec21838-1eb1-4b83-a798-e79dd1d663e7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:05.583019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] MFA Rules not processed for user `8b06fb96cb7448098c64f05b88ff2db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:05.585328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:05.696291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d0ad9d342741eeb79db586249eaefb', 'request_id': 'req-3ec21838-1eb1-4b83-a798-e79dd1d663e7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:05.717164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d0ad9d342741eeb79db586249eaefb', 'request_id': 'req-3ec21838-1eb1-4b83-a798-e79dd1d663e7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:05.726418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:05.748200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] The token cache is being invalidate because project 04d0ad9d342741eeb79db586249eaefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:05.749648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:05.752598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3ec21838-1eb1-4b83-a798-e79dd1d663e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:05.758149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 856/1708] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:04 2022] DELETE /identity/v3/projects/04d0ad9d342741eeb79db586249eaefb => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:05.762895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f264f-0ce4-46fa-a266-62eef1a29013 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.763936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f264f-0ce4-46fa-a266-62eef1a29013 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.764360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f264f-0ce4-46fa-a266-62eef1a29013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:05.826961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b81f264f-0ce4-46fa-a266-62eef1a29013 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:05.832966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b81f264f-0ce4-46fa-a266-62eef1a29013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:05.856202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 853/1709] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:05.856657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:05.858646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:05.992532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 857/1710] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:05.997831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5989e9-e532-4763-a1da-06644c8ab34c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:05.997831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5989e9-e532-4763-a1da-06644c8ab34c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:05.997831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5989e9-e532-4763-a1da-06644c8ab34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.028008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45731b63-125c-47d4-9488-b15f31d466b3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:06.053550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:06.053550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:06.053550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:06.053550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.054579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:06.054579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:06.054741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bf5989e9-e532-4763-a1da-06644c8ab34c None None] MFA Rules not processed for user `0a1b019c66e3439a8eb18890e1f05bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:06.054741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bf5989e9-e532-4763-a1da-06644c8ab34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:06.232345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 858/1711] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:06.233984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:06.234527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:06.235131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.262458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:06.264303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:06.284601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 859/1712] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:06.286282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:06.306906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a937f9-d27f-44ea-8ebf-87651dd18f77 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:06.313711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:06.314330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:06.314670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:06.315119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.316043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:06.316463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:06.318552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:06.346055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 854/1713] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:05 2022] POST /identity/v3/projects => generated 387 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:06.347306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 860/1714] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:06.352170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:06.361677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:06.385510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2b94-4ba0-4183-b326-3a5f7931c427 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:06.541742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533177-dc97-44f5-9370-1f6ec4da3ae0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:06.560738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:06.561648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:06.562221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:06.562635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.564167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:06.567194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:06.580360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:06.585625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:06.586688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:06.587263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.588278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:06.602811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:06.727637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 855/1715] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:06 2022] POST /identity/v3/projects => generated 403 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:06.728756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:06.791864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 861/1716] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:06 2022] POST /identity/v3/users => generated 300 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:06.793097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:06.841436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01960-e722-4d1c-9530-6255348690bf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:06.924878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1e7a-c2d4-4f17-b9b2-329e083a7178 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:06.943006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:06.943642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:06.943934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:06.944181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:06.944825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:06.946804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.011215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.011986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.012507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.012877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.013675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.016418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.037143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 862/1717] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:07.038203 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.050880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:07.064377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d8d61-5ca1-45a0-8ee1-bc080f9f3b26 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:07.081507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.082286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.082564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.082841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] PATH_INFO: `/v3/projects/76f32c0ca71c404d8537601d92426398/users/297ecf43fdc8494db23ec23bf0f59323/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.106489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f32c0ca71c404d8537601d92426398, user_id=297ecf43fdc8494db23ec23bf0f59323, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.112357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.129650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 856/1718] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:06 2022] POST /identity/v3/users => generated 302 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:07.134557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.181761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b0481-efe1-40f1-a789-f4e702d828cc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:07.194782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.195639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.196080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.196365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.197054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.198850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.210947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 857/1719] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:07.229607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.258885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1fdb-8c14-46f2-8a43-a8c5ab1937a6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:07.269741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.273819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.274130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.274406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.275101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.279181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.300095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 858/1720] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:07.304722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.311571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 863/1721] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:07 2022] PUT /identity/v3/projects/76f32c0ca71c404d8537601d92426398/users/297ecf43fdc8494db23ec23bf0f59323/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:07.319117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebab209-9bbb-49da-be94-86d6d990d95e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:07.342882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.437090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3e1d4-99fa-4663-a6f0-9878a33031d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.439128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e1d4-99fa-4663-a6f0-9878a33031d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.439569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e1d4-99fa-4663-a6f0-9878a33031d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.440005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e1d4-99fa-4663-a6f0-9878a33031d9 admin admin] PATH_INFO: `/v3/projects/b0d49982ef85476185ebf5abbcd8442a/users/34b8cd18fc6c4f95b6450245abcbb7c4/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.473540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e1d4-99fa-4663-a6f0-9878a33031d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d49982ef85476185ebf5abbcd8442a, user_id=34b8cd18fc6c4f95b6450245abcbb7c4, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.480238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e1d4-99fa-4663-a6f0-9878a33031d9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.480922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22758a-4004-4dce-8a89-25b17f061989 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:07.487740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.488594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.488939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.489228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.489948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.491785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.504756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 864/1722] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:07.508818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.520254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49f2b-8c89-4382-9f5f-db8af18e7f6c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:07.525842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f2b6-c0b6-48ee-b8eb-5b7567a022c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:07.526276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f2b6-c0b6-48ee-b8eb-5b7567a022c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.526499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f2b6-c0b6-48ee-b8eb-5b7567a022c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.526768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f2b6-c0b6-48ee-b8eb-5b7567a022c5 admin admin] PATH_INFO: `/v3/projects/76f32c0ca71c404d8537601d92426398/users/297ecf43fdc8494db23ec23bf0f59323/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.529195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f2b6-c0b6-48ee-b8eb-5b7567a022c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f32c0ca71c404d8537601d92426398, user_id=297ecf43fdc8494db23ec23bf0f59323, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:07.532721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f2b6-c0b6-48ee-b8eb-5b7567a022c5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:07.544459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 865/1723] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:07 2022] PUT /identity/v3/projects/76f32c0ca71c404d8537601d92426398/users/297ecf43fdc8494db23ec23bf0f59323/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:07.557407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991d945-d261-4314-b8ef-856623beab97 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.557639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991d945-d261-4314-b8ef-856623beab97 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.557724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991d945-d261-4314-b8ef-856623beab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.593527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1991d945-d261-4314-b8ef-856623beab97 None None] MFA Rules not processed for user `297ecf43fdc8494db23ec23bf0f59323`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:07.595643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1991d945-d261-4314-b8ef-856623beab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:07.630443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 859/1724] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:07 2022] PUT /identity/v3/projects/b0d49982ef85476185ebf5abbcd8442a/users/34b8cd18fc6c4f95b6450245abcbb7c4/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:07.640251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:07.640643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:07.642672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:07.695265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:07.701868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:07.880074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 866/1725] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:07.891845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991d945-d261-4314-b8ef-856623beab97 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.894725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1991d945-d261-4314-b8ef-856623beab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:07.912439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 860/1726] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:07.936863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:07.939532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:08.032768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991d945-d261-4314-b8ef-856623beab97 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:08.092691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377148f0-af2c-4a2e-8fce-8b05bb312f46 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:08.097758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:08.098713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:08.099279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:08.099627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:08.117912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:08.119606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:08.143787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 861/1727] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:08.183472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130423a-da21-4587-aee9-533d20a6e59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:08.187539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130423a-da21-4587-aee9-533d20a6e59e service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:08.222511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130423a-da21-4587-aee9-533d20a6e59e service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:08.222511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130423a-da21-4587-aee9-533d20a6e59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:08.343664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130423a-da21-4587-aee9-533d20a6e59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:08.345565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130423a-da21-4587-aee9-533d20a6e59e service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:08.366477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 867/1728] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:08.414382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:08.435810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33126e7-29ff-43b8-aad2-273474401f5a service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:08.450728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:08.452212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:08.452492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:08.452773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] PATH_INFO: `/v3/users/8b06fb96cb7448098c64f05b88ff2db1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:08.460020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b06fb96cb7448098c64f05b88ff2db1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:08.466507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:08.799299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:08.804341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b06fb96cb7448098c64f05b88ff2db1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:08.807505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b06fb96cb7448098c64f05b88ff2db1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:08.808261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b06fb96cb7448098c64f05b88ff2db1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:08.824983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b06fb96cb7448098c64f05b88ff2db1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:08.914361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bea270a6-623f-46e0-9f5a-68c3842ac389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b06fb96cb7448098c64f05b88ff2db1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:08.979671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 862/1729] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:08 2022] DELETE /identity/v3/users/8b06fb96cb7448098c64f05b88ff2db1 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:08.981775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:08.982605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:08.982897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:09.004042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:09.008201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:09.008201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:09.045975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:09.048968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:09.130531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:09.131996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:09.163478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 868/1730] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:09.183220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:09.188414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:09.291801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 863/1731] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:46:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:09.346888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01d047-890e-4fa5-90a3-4851e1f006b8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:09.350804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:09.351423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:09.351693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:09.352082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:09.362738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:09.365295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:09.389507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 869/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:09.999847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:10.002136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:10.284654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18b9b-c10e-4f68-8507-6cad0dc7c16e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:10.293234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:10.296600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:10.296600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:10.296600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:10.308747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:10.313829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:10.329999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 864/1733] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:46:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:46:10.799526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:11.236079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:11.236079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:11.290392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17419a-22e9-4659-b5cf-49bf031c03fe service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:11.348227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:11.349080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:11.349597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:11.350059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] PATH_INFO: `/v3/projects/3776d31746df4538a761c241f4708054` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:11.352970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3776d31746df4538a761c241f4708054)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:11.355104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:11.730809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:11.823521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3776d31746df4538a761c241f4708054', 'request_id': 'req-17e21211-5019-474d-b734-207df0b8d864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:11.946799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3776d31746df4538a761c241f4708054', 'request_id': 'req-17e21211-5019-474d-b734-207df0b8d864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:11.960933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3776d31746df4538a761c241f4708054', 'request_id': 'req-17e21211-5019-474d-b734-207df0b8d864'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:11.988139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] The token cache is being invalidate because project 3776d31746df4538a761c241f4708054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:11.988454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:11.991312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-17e21211-5019-474d-b734-207df0b8d864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:11.997625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 870/1734] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:11 2022] DELETE /identity/v3/projects/3776d31746df4538a761c241f4708054 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:11.999459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:12.014307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe38fa-5ab6-46d5-a543-13987369e8ec service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:12.232316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:12.232316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:12.232316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:12.232316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] PATH_INFO: `/v3/users/297ecf43fdc8494db23ec23bf0f59323` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:12.233633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297ecf43fdc8494db23ec23bf0f59323)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:12.233633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:12.654054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:12.655081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:12.655526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:12.708414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:12.708414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:12.728674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297ecf43fdc8494db23ec23bf0f59323'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:12.732826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297ecf43fdc8494db23ec23bf0f59323'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:12.734255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297ecf43fdc8494db23ec23bf0f59323'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:12.770783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297ecf43fdc8494db23ec23bf0f59323'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:12.961508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 871/1735] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Sep 9 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:12.972695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297ecf43fdc8494db23ec23bf0f59323'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:12.978133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:12.979899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:13.023370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dc9dc-eec5-4d1e-a5c0-1c6e66ef0b66 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:13.046232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f933b-4192-419a-aafb-d8d3faab97df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:13.047079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f933b-4192-419a-aafb-d8d3faab97df service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:13.047577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f933b-4192-419a-aafb-d8d3faab97df service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:13.048054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f933b-4192-419a-aafb-d8d3faab97df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:13.061076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f933b-4192-419a-aafb-d8d3faab97df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:13.063422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f933b-4192-419a-aafb-d8d3faab97df service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:13.082489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 865/1736] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:11 2022] DELETE /identity/v3/users/297ecf43fdc8494db23ec23bf0f59323 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:13.101726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 872/1737] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:13.448438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:13.544507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940533-e837-47e9-bf9d-97a35949a1ac None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:13.544507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940533-e837-47e9-bf9d-97a35949a1ac None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:13.544507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940533-e837-47e9-bf9d-97a35949a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:13.606425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-35940533-e837-47e9-bf9d-97a35949a1ac None None] MFA Rules not processed for user `61ed413fdfab427287e7355612a795b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:13.607662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-35940533-e837-47e9-bf9d-97a35949a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:13.734724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feed09-f9f3-493b-9b54-a415215980a3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:13.747743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:13.751432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:13.752003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:13.752478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:13.777874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:13.780989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 873/1738] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:13.783731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:13.841705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 866/1739] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:14.963313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:14.964516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:14.965085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:15.018343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] MFA Rules not processed for user `34b8cd18fc6c4f95b6450245abcbb7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:15.019911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:15.241391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 874/1740] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:15.246711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:15.249478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:15.473268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:15.551668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921968f-6695-4117-a94f-aae199d37793 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:15.564659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:15.566859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:15.569701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:15.571465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:15.573477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:15.579106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:15.806668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 867/1741] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:15 2022] POST /identity/v3/projects => generated 403 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:15.812294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:15.832999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be307-0f0e-4ef1-930e-a0ba4a6a7bf8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:15.964106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:15.965803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:15.966176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:15.966545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:15.967281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:15.970876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:16.339860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 875/1742] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:15 2022] POST /identity/v3/users => generated 308 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:16.374631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:16.395763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec752c7-443c-41d1-b1c9-702f874558be admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:16.416276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:16.417797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:16.418417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:16.419858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:16.421041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:16.432287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:16.467858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 868/1743] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:16.475088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:16.508568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd211c-8de0-4a4d-8b93-8b82adfdf41f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:16.527820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:16.530676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:16.532954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:16.533446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] PATH_INFO: `/v3/projects/06f12d0d632f4a8eb43a033786de966b/users/f40a9f5c3caa40639d6ae933bd56150f/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:16.595563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f12d0d632f4a8eb43a033786de966b, user_id=f40a9f5c3caa40639d6ae933bd56150f, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:16.598372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:16.700067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:16.702249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:16.734816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 876/1744] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:16 2022] PUT /identity/v3/projects/06f12d0d632f4a8eb43a033786de966b/users/f40a9f5c3caa40639d6ae933bd56150f/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:16.738823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:16.743021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883039-cd2f-4be8-b055-1dfb00e0ca9c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:16.956474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:16.957138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:16.957389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9dc3-7555-4b4b-abb3-b3eb9f8b3026 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:16.957511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:16.957707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] PATH_INFO: `/v3/projects/76f32c0ca71c404d8537601d92426398` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:16.960280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f32c0ca71c404d8537601d92426398)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:16.963383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:16.965139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275eb62-3432-4d1b-8102-05716b5c4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:16.967162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275eb62-3432-4d1b-8102-05716b5c4838 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:16.970017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275eb62-3432-4d1b-8102-05716b5c4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:16.970899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275eb62-3432-4d1b-8102-05716b5c4838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:16.972143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275eb62-3432-4d1b-8102-05716b5c4838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:16.974492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275eb62-3432-4d1b-8102-05716b5c4838 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:17.005423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 877/1745] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:17.011885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:17.012495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181afd-d220-4408-9bea-5f9527ec793d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.012941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181afd-d220-4408-9bea-5f9527ec793d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.013461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181afd-d220-4408-9bea-5f9527ec793d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.016475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 878/1746] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:46:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:46:17.017470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181afd-d220-4408-9bea-5f9527ec793d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:17.052199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181afd-d220-4408-9bea-5f9527ec793d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:17.092259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af4e3f-68a3-4089-8c52-70793f51a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:17.092259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4e3f-68a3-4089-8c52-70793f51a598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.092259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4e3f-68a3-4089-8c52-70793f51a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.092530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4e3f-68a3-4089-8c52-70793f51a598 admin admin] PATH_INFO: `/v3/projects/06f12d0d632f4a8eb43a033786de966b/users/f40a9f5c3caa40639d6ae933bd56150f/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.099141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af4e3f-68a3-4089-8c52-70793f51a598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f12d0d632f4a8eb43a033786de966b, user_id=f40a9f5c3caa40639d6ae933bd56150f, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:17.108392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af4e3f-68a3-4089-8c52-70793f51a598 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:17.151647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 879/1747] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:17 2022] PUT /identity/v3/projects/06f12d0d632f4a8eb43a033786de966b/users/f40a9f5c3caa40639d6ae933bd56150f/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:17.153113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e584-65ed-407e-be0e-fdc64c11ee19 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.153534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e584-65ed-407e-be0e-fdc64c11ee19 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.153913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e584-65ed-407e-be0e-fdc64c11ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.199777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f32c0ca71c404d8537601d92426398', 'request_id': 'req-46bba38a-7666-48cb-9899-a10d07f9dd16'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:17.220831 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f32c0ca71c404d8537601d92426398', 'request_id': 'req-46bba38a-7666-48cb-9899-a10d07f9dd16'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:17.222209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dd57e584-65ed-407e-be0e-fdc64c11ee19 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:17.224849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dd57e584-65ed-407e-be0e-fdc64c11ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:17.347473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f32c0ca71c404d8537601d92426398', 'request_id': 'req-46bba38a-7666-48cb-9899-a10d07f9dd16'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:17.379966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] The token cache is being invalidate because project 76f32c0ca71c404d8537601d92426398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:17.379966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:17.385183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-46bba38a-7666-48cb-9899-a10d07f9dd16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:17.393596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 869/1748] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:16 2022] DELETE /identity/v3/projects/76f32c0ca71c404d8537601d92426398 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:17.423606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.423606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.423606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.479963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:17.482124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:17.533950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 880/1749] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:17.642396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 870/1750] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:17.644056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.644359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.644731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.699379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:17.700649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:17.758418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 881/1751] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:17.763038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:17.774977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552cc5-d64a-489e-828a-7c0fcc9eaa65 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:17.782156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:17.783154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.783649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.784137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.789986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:17.791680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:17.792712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:17.811617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 871/1752] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:17.817606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:17.830863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35c5b-4f67-4d2b-9c63-b3adabfd6bc6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:17.836526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:17.837548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:17.838089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:17.838574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:17.840027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:17.842354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:18.289235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:18.289235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:18.333158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd793342-2fbe-415b-9862-42718c2fb66a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:18.354020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cebe9a-03ec-49c1-801c-956f357a933a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:18.354900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cebe9a-03ec-49c1-801c-956f357a933a service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:18.355402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cebe9a-03ec-49c1-801c-956f357a933a service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:18.356392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cebe9a-03ec-49c1-801c-956f357a933a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:18.378792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 882/1753] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:17 2022] POST /identity/v3/projects => generated 385 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:18.382292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:18.384273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cebe9a-03ec-49c1-801c-956f357a933a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:18.391960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cebe9a-03ec-49c1-801c-956f357a933a service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:18.442211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 872/1754] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:18.597580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1476b-bed8-4632-addb-ff704b3d3cde admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:18.622484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:18.623313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:18.623762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:18.624183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:18.625019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:18.627158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:18.895635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3705-5cd8-4192-82a3-59dfcaa59217 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:18.896242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3705-5cd8-4192-82a3-59dfcaa59217 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:18.896706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3705-5cd8-4192-82a3-59dfcaa59217 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:18.898364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 873/1755] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:46:18.989135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:18.989684 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:18.990102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:19.030437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:19.034761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:19.134738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 883/1756] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:18 2022] POST /identity/v3/users => generated 293 bytes in 753 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:19.139532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:19.161525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73634c-83e1-40cf-8ce4-168d48a2d077 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:19.181005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:19.196511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:19.198115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:19.199684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:19.202536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:19.208737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:19.231426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 874/1757] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:19.234478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 884/1758] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:19.239967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:19.290287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43af49-0a18-4480-9ca0-9ca305e863e7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:19.508660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:19.508660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:19.508660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:19.508660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:19.510770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:19.510770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:19.510770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 875/1759] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:19.511689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:19.511689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074b932-8963-4df0-9863-068b23e34d3b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:19.511689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:19.511689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:19.512596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:19.512596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] PATH_INFO: `/v3/projects/42ef13b071674c31b91bd97c5103a41c/users/99c309daa6d7486e826bc74442db9209/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:19.512596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ef13b071674c31b91bd97c5103a41c, user_id=99c309daa6d7486e826bc74442db9209, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:19.512596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:19.544462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:19.566909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789eab9-8b44-4b34-9b07-ceaba722c7ab admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:19.578769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49b48f-ab11-493f-be5d-ae4e4e57783f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:19.579486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49b48f-ab11-493f-be5d-ae4e4e57783f service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:19.579788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49b48f-ab11-493f-be5d-ae4e4e57783f service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:19.580349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49b48f-ab11-493f-be5d-ae4e4e57783f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:19.596088 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49b48f-ab11-493f-be5d-ae4e4e57783f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:19.598347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49b48f-ab11-493f-be5d-ae4e4e57783f service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:19.638963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 876/1760] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:19.653811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:19.683812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 885/1761] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:19 2022] PUT /identity/v3/projects/42ef13b071674c31b91bd97c5103a41c/users/99c309daa6d7486e826bc74442db9209/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:19.694980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:19.695519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:19.696041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:19.751115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] MFA Rules not processed for user `99c309daa6d7486e826bc74442db9209`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:19.760890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:19.941285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 877/1762] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:19.956891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:19.959683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:20.104743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430c3b-2c20-4d91-89f3-f033d644df5f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:20.142622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad95ac-9dd8-4ffd-b7e3-83a2319d2b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:20.143324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad95ac-9dd8-4ffd-b7e3-83a2319d2b15 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:20.143603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad95ac-9dd8-4ffd-b7e3-83a2319d2b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:20.143934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad95ac-9dd8-4ffd-b7e3-83a2319d2b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:20.159587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad95ac-9dd8-4ffd-b7e3-83a2319d2b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:20.161307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad95ac-9dd8-4ffd-b7e3-83a2319d2b15 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:20.184953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 886/1763] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:20.233359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:20.386636 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765d46d-e6c3-4d5d-9f35-1f9c1f4ba52c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:20.397683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:20.399981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:20.400708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:20.401302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] PATH_INFO: `/v3/users/99c309daa6d7486e826bc74442db9209` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:20.403538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c309daa6d7486e826bc74442db9209)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:20.407610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:20.850474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c309daa6d7486e826bc74442db9209'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:20.851300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c309daa6d7486e826bc74442db9209'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:20.852794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c309daa6d7486e826bc74442db9209'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:20.873044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c309daa6d7486e826bc74442db9209'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:20.988057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c309daa6d7486e826bc74442db9209'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:21.076577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 878/1764] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:20 2022] DELETE /identity/v3/users/99c309daa6d7486e826bc74442db9209 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:21.083086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:21.083914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:21.084607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:21.134071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:21.138754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:21.241747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:21.304980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 887/1765] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:21.338344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:21.340476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:21.436664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf354a1-fefb-45cd-a9a3-b8af9e869cd9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:21.441879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c42c8-6ef5-49c9-b028-5226b8100133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:21.443063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c42c8-6ef5-49c9-b028-5226b8100133 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:21.443587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c42c8-6ef5-49c9-b028-5226b8100133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:21.444067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c42c8-6ef5-49c9-b028-5226b8100133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:21.459822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c42c8-6ef5-49c9-b028-5226b8100133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:21.462303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c42c8-6ef5-49c9-b028-5226b8100133 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:21.481374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 879/1766] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:22.683761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:22.684308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:22.697457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb2d0-581b-4b07-b3c1-370794da776f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:22.702109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:22.702843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:22.703181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:22.703452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] PATH_INFO: `/v3/projects/42ef13b071674c31b91bd97c5103a41c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:22.704583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ef13b071674c31b91bd97c5103a41c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:22.706748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:22.872090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ef13b071674c31b91bd97c5103a41c', 'request_id': 'req-964ec52d-a266-4356-9116-0544dc5cba46'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:23.000450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a8e6-b09c-481b-9865-5b000b91b6cb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.001496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a8e6-b09c-481b-9865-5b000b91b6cb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.007480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a8e6-b09c-481b-9865-5b000b91b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.021384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ef13b071674c31b91bd97c5103a41c', 'request_id': 'req-964ec52d-a266-4356-9116-0544dc5cba46'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:23.042765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ef13b071674c31b91bd97c5103a41c', 'request_id': 'req-964ec52d-a266-4356-9116-0544dc5cba46'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:23.059327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] The token cache is being invalidate because project 42ef13b071674c31b91bd97c5103a41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:23.059928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:23.060790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-964ec52d-a266-4356-9116-0544dc5cba46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:23.063359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 888/1767] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:22 2022] DELETE /identity/v3/projects/42ef13b071674c31b91bd97c5103a41c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:23.068553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.069423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.069824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.072902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3612a8e6-b09c-481b-9865-5b000b91b6cb None None] MFA Rules not processed for user `f40a9f5c3caa40639d6ae933bd56150f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:23.074344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3612a8e6-b09c-481b-9865-5b000b91b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:23.115154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:23.115803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:23.167920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 880/1768] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:23.176643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 889/1769] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:23.185695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.185985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.186261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.206976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:23.208203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:23.216589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 881/1770] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:23.221961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:23.232424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b2ba-f9e0-4ccf-bb06-cf182331ab38 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:23.238563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:23.239239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.239452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.239732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.240382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:23.240681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:23.242388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:23.261511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 890/1771] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:23.262841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:23.279098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae563-5670-4fef-b305-af9fd141bdcf None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:23.294047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:23.294674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.294956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.295222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.295871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:23.298059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:23.481068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 882/1772] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:23 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:23.490923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:23.505482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deaa99-ea1a-4178-b0fb-f8084fb7d756 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:23.576058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:23.576795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.577170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.577594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.579281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:23.581367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:23.717345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 891/1773] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:23 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:23.722459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:23.732814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3d02-e9c6-4f0b-ab78-c3ef3aadb92d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:23.737464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:23.738054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.738332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.738603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.739317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:23.741056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:23.751578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 883/1774] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:23.766972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:23.777438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3464-7b76-48e9-a710-f20dfcd67940 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:23.782712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d5c79-7403-4339-a9a7-fcf766d5aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:23.783303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d5c79-7403-4339-a9a7-fcf766d5aac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.783577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d5c79-7403-4339-a9a7-fcf766d5aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.783844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d5c79-7403-4339-a9a7-fcf766d5aac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.784472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d5c79-7403-4339-a9a7-fcf766d5aac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:23.786134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d5c79-7403-4339-a9a7-fcf766d5aac5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:23.798180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 892/1775] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:23.802474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:23.813482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65cad0-5f51-45a7-b929-987b06425d44 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:23.818780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:23.819601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:23.819601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:23.819601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] PATH_INFO: `/v3/projects/7a6c0440a9f74f88b6f6e159fe7976a1/users/a551c537798a45898c35e506d6af0b5e/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:23.840117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6c0440a9f74f88b6f6e159fe7976a1, user_id=a551c537798a45898c35e506d6af0b5e, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:23.843000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:24.010065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 884/1776] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:23 2022] PUT /identity/v3/projects/7a6c0440a9f74f88b6f6e159fe7976a1/users/a551c537798a45898c35e506d6af0b5e/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:24.019895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00cd0f-6b8a-406b-b6ce-2a4d1d53fa39 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:24.020180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00cd0f-6b8a-406b-b6ce-2a4d1d53fa39 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:24.020450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00cd0f-6b8a-406b-b6ce-2a4d1d53fa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:24.050124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3d00cd0f-6b8a-406b-b6ce-2a4d1d53fa39 None None] MFA Rules not processed for user `a551c537798a45898c35e506d6af0b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:24.051822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d00cd0f-6b8a-406b-b6ce-2a4d1d53fa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:24.125150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 893/1777] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:24.136063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:24.137821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:24.194165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca0a1-5fc3-4214-bdad-8f19a695b889 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:24.197958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef916-b3ee-4dac-8192-86380ca775f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:24.198562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef916-b3ee-4dac-8192-86380ca775f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:24.198854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef916-b3ee-4dac-8192-86380ca775f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:24.199117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef916-b3ee-4dac-8192-86380ca775f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:24.207885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef916-b3ee-4dac-8192-86380ca775f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:24.209506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef916-b3ee-4dac-8192-86380ca775f0 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:24.218798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 885/1778] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:24.308090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3092e6-431c-4675-b351-e2484cf248e0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:24.308378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3092e6-431c-4675-b351-e2484cf248e0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:24.308654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3092e6-431c-4675-b351-e2484cf248e0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:24.310318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 894/1779] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:46:24.320640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b1b17-b438-4469-9d9b-f1c6a04ac4cf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:24.321004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b1b17-b438-4469-9d9b-f1c6a04ac4cf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:24.321485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b1b17-b438-4469-9d9b-f1c6a04ac4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:24.344783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ad1b1b17-b438-4469-9d9b-f1c6a04ac4cf None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:24.346078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ad1b1b17-b438-4469-9d9b-f1c6a04ac4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:24.417932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 886/1780] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:46:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:24.429400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3092e6-431c-4675-b351-e2484cf248e0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:24.431116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a3092e6-431c-4675-b351-e2484cf248e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:24.448208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3092e6-431c-4675-b351-e2484cf248e0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:24.454168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb87ffc-916d-431f-aacc-2572e330734a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:24.454838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87ffc-916d-431f-aacc-2572e330734a service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:24.455111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87ffc-916d-431f-aacc-2572e330734a service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:24.455378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87ffc-916d-431f-aacc-2572e330734a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:24.464283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb87ffc-916d-431f-aacc-2572e330734a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:24.466080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb87ffc-916d-431f-aacc-2572e330734a service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:24.476543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 895/1781] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:25.017944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:25.150290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c4d2-08f5-42f0-af84-4b012729cab5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:25.150578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c4d2-08f5-42f0-af84-4b012729cab5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:25.150850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c4d2-08f5-42f0-af84-4b012729cab5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:25.152245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 887/1782] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:46:25.170729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:25.171464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:25.171464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:25.192619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:25.193851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:25.202434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 896/1783] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:46:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:25.232854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7c4d2-08f5-42f0-af84-4b012729cab5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:25.252179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7c4d2-08f5-42f0-af84-4b012729cab5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:25.257428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:25.258285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:25.258838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:25.259321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:25.271179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:25.273281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:25.284593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 888/1784] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:25.328404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:25.330388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:25.368173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:25.369708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:25.401095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ff25-aaf5-4904-b256-a61057e58d89 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:25.406417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:25.407060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:25.407343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:25.407609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] PATH_INFO: `/v3/users/ca8d85b7f94641659129b722f6f5f29f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:25.408864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8d85b7f94641659129b722f6f5f29f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:25.410850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:25.447045 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba981-a7b8-4922-833e-85ee0057920f service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:25.451597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:25.452221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:25.452584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:25.452863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] PATH_INFO: `/v3/users/34b8cd18fc6c4f95b6450245abcbb7c4` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:25.454119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b8cd18fc6c4f95b6450245abcbb7c4)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:25.456046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:25.611761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8d85b7f94641659129b722f6f5f29f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.612423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8d85b7f94641659129b722f6f5f29f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.661707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b8cd18fc6c4f95b6450245abcbb7c4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.662350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b8cd18fc6c4f95b6450245abcbb7c4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.662978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b8cd18fc6c4f95b6450245abcbb7c4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.669737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b8cd18fc6c4f95b6450245abcbb7c4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.740273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8d85b7f94641659129b722f6f5f29f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.749098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8d85b7f94641659129b722f6f5f29f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.749098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-554e22fa-f1e3-4550-957a-072b93276227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8d85b7f94641659129b722f6f5f29f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.766756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 897/1785] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:25 2022] DELETE /identity/v3/users/ca8d85b7f94641659129b722f6f5f29f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:25.771199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:25.771485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:25.771846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:25.793493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:25.794628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:25.858494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b8cd18fc6c4f95b6450245abcbb7c4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:25.869357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 898/1786] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:25.880110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:25.881865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:25.886459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 889/1787] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:25 2022] DELETE /identity/v3/users/34b8cd18fc6c4f95b6450245abcbb7c4 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:25.965042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564180d-0461-4f92-aa86-a671a7d294a8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:26.028968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:26.029753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:26.036065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:26.042688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:26.215289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:26.217945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:26.277158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 899/1788] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:26.525055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:26.527259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:26.542498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c6c5-142c-4202-b74e-09dd8b82cae3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:26.548969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:26.549577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:26.549896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:26.551035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] PATH_INFO: `/v3/projects/b0d49982ef85476185ebf5abbcd8442a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:26.553080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d49982ef85476185ebf5abbcd8442a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:26.555314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:26.759740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d49982ef85476185ebf5abbcd8442a', 'request_id': 'req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:26.766704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d49982ef85476185ebf5abbcd8442a', 'request_id': 'req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:26.878144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d49982ef85476185ebf5abbcd8442a', 'request_id': 'req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:26.896647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] The token cache is being invalidate because project b0d49982ef85476185ebf5abbcd8442a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:26.897176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:26.898133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:26.902131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 890/1789] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:26 2022] DELETE /identity/v3/projects/b0d49982ef85476185ebf5abbcd8442a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:26.907314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:26.908963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:26.944285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0c1d-e24f-4e08-a364-b45b997e6f5b service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:27.045400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:27.046703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:27.047000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:27.047250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] PATH_INFO: `/v3/users/f40a9f5c3caa40639d6ae933bd56150f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:27.049674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40a9f5c3caa40639d6ae933bd56150f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:27.051578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:27.459436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40a9f5c3caa40639d6ae933bd56150f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.465672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40a9f5c3caa40639d6ae933bd56150f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.585570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40a9f5c3caa40639d6ae933bd56150f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.596649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40a9f5c3caa40639d6ae933bd56150f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.597925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40a9f5c3caa40639d6ae933bd56150f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.618345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 900/1790] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:26 2022] DELETE /identity/v3/users/f40a9f5c3caa40639d6ae933bd56150f => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:27.637067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:27.638497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:27.691182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d4a21-55a3-445b-bc92-a28dd62cbfd4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:27.781647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:27.782373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:27.782766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:27.783107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] PATH_INFO: `/v3/projects/d25630338a2741b2942e8f1557de9d58` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:27.784379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25630338a2741b2942e8f1557de9d58)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:27.786733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:27.942724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25630338a2741b2942e8f1557de9d58', 'request_id': 'req-0f571954-399b-4597-a12a-d634e44cbf8f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.948416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25630338a2741b2942e8f1557de9d58', 'request_id': 'req-0f571954-399b-4597-a12a-d634e44cbf8f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:27.994331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:27.995273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:28.010026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780108-f8a8-4f75-9d42-7cde52bb8a75 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.015778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25630338a2741b2942e8f1557de9d58', 'request_id': 'req-0f571954-399b-4597-a12a-d634e44cbf8f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.030104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] The token cache is being invalidate because project d25630338a2741b2942e8f1557de9d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:28.030545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.031483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0f571954-399b-4597-a12a-d634e44cbf8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.033687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 891/1791] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:27 2022] DELETE /identity/v3/projects/d25630338a2741b2942e8f1557de9d58 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:28.038559 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64ff0b-926f-4fee-9d32-fb81ba8b2278 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.039018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64ff0b-926f-4fee-9d32-fb81ba8b2278 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.039376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64ff0b-926f-4fee-9d32-fb81ba8b2278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.062349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6a64ff0b-926f-4fee-9d32-fb81ba8b2278 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:28.063631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6a64ff0b-926f-4fee-9d32-fb81ba8b2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:28.092693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.093830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.094542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.094683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] PATH_INFO: `/v3/projects/06f12d0d632f4a8eb43a033786de966b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.095838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f12d0d632f4a8eb43a033786de966b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.097926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.127057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 892/1792] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:28.134805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.135091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.135364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.156269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:28.157516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:28.165800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 893/1793] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:28.169874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.179731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37868c-ba48-4e29-9a11-2f416ffa0cc6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.184272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.184866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.185140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.185442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.186081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:28.186384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.188164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.199722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 894/1794] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:46:28.204057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.213761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282d115-68a9-45ba-ac96-1883dc51ec7d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.221620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.222814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.223092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.223397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.224696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.227418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.294737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:28.326920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f12d0d632f4a8eb43a033786de966b', 'request_id': 'req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.354514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 895/1795] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:28.362649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.426834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd03dfe-34d1-420d-8bc6-139cc20ec9b2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.431620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.432290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.432689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.432947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.433618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.435525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.454639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f12d0d632f4a8eb43a033786de966b', 'request_id': 'req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.460673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f12d0d632f4a8eb43a033786de966b', 'request_id': 'req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.473527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] The token cache is being invalidate because project 06f12d0d632f4a8eb43a033786de966b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:28.473830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.474554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f760ff3c-6682-41b0-af28-3a3a13fd6fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:28.476128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 901/1796] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:27 2022] DELETE /identity/v3/projects/06f12d0d632f4a8eb43a033786de966b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:28.480828 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f266-3ec3-452a-b0e4-56e40f585d11 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.481134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f266-3ec3-452a-b0e4-56e40f585d11 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.481610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f266-3ec3-452a-b0e4-56e40f585d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.508761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f0d4f266-3ec3-452a-b0e4-56e40f585d11 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:28.510513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0d4f266-3ec3-452a-b0e4-56e40f585d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:28.528510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 902/1797] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:28.529983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.531495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.531778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.556697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 896/1798] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:28.560425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.563830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:28.572371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:28.584026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:28.586770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:28.587058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd66f-4545-4312-8b96-411f6ccafeb4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.597902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.598846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.599245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.599805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.600810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.602746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.612361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 903/1799] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:28.613458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.636775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 897/1800] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:28.638267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.652890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5baad3-6806-4640-9c6b-5f05db984669 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.653097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d78c-2ded-4335-a1ed-74eadd14a8c8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.659713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.660438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.660789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.661292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.662412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.664350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.667789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.668468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.668754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.669026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.669783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:28.670082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.675433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.681140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 898/1801] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:28.686322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.701895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486ad55-6b98-4e3a-94f0-7444cc40c12d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.712679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b3cb-2ddb-47ed-8c82-62881f710d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.713679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b3cb-2ddb-47ed-8c82-62881f710d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.714590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b3cb-2ddb-47ed-8c82-62881f710d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.715380 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b3cb-2ddb-47ed-8c82-62881f710d78 admin admin] PATH_INFO: `/v3/projects/044e2480073d452eaf281da5b9da256c/users/cb396c112e3f4fd3834ff9d14abdec89/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.730202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 904/1802] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:28.735690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:28.753473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b3cb-2ddb-47ed-8c82-62881f710d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044e2480073d452eaf281da5b9da256c, user_id=cb396c112e3f4fd3834ff9d14abdec89, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.758237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b3cb-2ddb-47ed-8c82-62881f710d78 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.778804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e95e1-921a-47af-9f2c-7689227e022e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:28.783240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9470f-911c-4523-a28b-652a1f610336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:28.784418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9470f-911c-4523-a28b-652a1f610336 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.785186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9470f-911c-4523-a28b-652a1f610336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.786165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9470f-911c-4523-a28b-652a1f610336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.789572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9470f-911c-4523-a28b-652a1f610336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:28.792430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9470f-911c-4523-a28b-652a1f610336 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:28.967962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 899/1803] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:28 2022] PUT /identity/v3/projects/044e2480073d452eaf281da5b9da256c/users/cb396c112e3f4fd3834ff9d14abdec89/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:28.973401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676225-9f48-460f-afa9-b8018cbd7f11 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.975828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676225-9f48-460f-afa9-b8018cbd7f11 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.976687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 905/1804] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:28.980015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676225-9f48-460f-afa9-b8018cbd7f11 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.985547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba8564-8f31-4e22-8e82-010f1d32f048 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:28.986650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 900/1805] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:46:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:46:28.988547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba8564-8f31-4e22-8e82-010f1d32f048 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:28.990078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba8564-8f31-4e22-8e82-010f1d32f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:28.994971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676225-9f48-460f-afa9-b8018cbd7f11 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.082455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e9ba8564-8f31-4e22-8e82-010f1d32f048 None None] MFA Rules not processed for user `cb396c112e3f4fd3834ff9d14abdec89`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:29.083759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9ba8564-8f31-4e22-8e82-010f1d32f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:29.169096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676225-9f48-460f-afa9-b8018cbd7f11 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.170266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 906/1806] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:29.172697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.173184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.173639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.179356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.183514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.183514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.183514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.183514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.184391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.213672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:29.215021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:29.269568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 901/1807] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:28 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:29.269568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.279673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d16c-0999-4cf4-88af-68dd619d0695 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.285021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.285966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.286095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.286408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.288818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.291940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.319184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 907/1808] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:29.327539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.337815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc319-18d2-488d-822c-df4b64e5c83e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.348308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.349176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.349558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.349939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.350984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.355046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.370788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 908/1809] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:29.370788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.371364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:29.403122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f844b0-add6-4e09-9d8e-7c4cb6d83b74 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.413520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.414229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.414801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.415832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.427117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.428953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.439575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 902/1810] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:29 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:29.440447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.443531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 909/1811] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:29.445050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.462575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a26f-5db6-499d-aa88-c048e24abc4c service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.525091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b11a-c36b-440e-8252-3c76db80f2a5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.530145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.531093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.531452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.531811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.532529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.534364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.541668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.542362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.542712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.543106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.543963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.547040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.552408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 903/1812] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:29.553771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.564169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:29.582133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17f3eb-c19c-499e-95ac-95394171e113 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.587168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.587888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.588260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.588603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] PATH_INFO: `/v3/users/a551c537798a45898c35e506d6af0b5e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.590111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a551c537798a45898c35e506d6af0b5e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.592417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.711764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 910/1813] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:29 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:29.713293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.723640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421a7d-b399-4972-ba95-0904832d7639 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.728429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:29.729076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.729498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.729825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] PATH_INFO: `/v3/projects/73089c0e9a074964ba6df9ea856060c2/users/15d1d57f0c954a9dbfd969776b994862/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:29.746075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73089c0e9a074964ba6df9ea856060c2, user_id=15d1d57f0c954a9dbfd969776b994862, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:29.748785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:29.814927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a551c537798a45898c35e506d6af0b5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:29.815724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a551c537798a45898c35e506d6af0b5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:29.816443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a551c537798a45898c35e506d6af0b5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:29.828881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a551c537798a45898c35e506d6af0b5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:29.858091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 911/1814] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:29 2022] PUT /identity/v3/projects/73089c0e9a074964ba6df9ea856060c2/users/15d1d57f0c954a9dbfd969776b994862/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:29.859839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:29.861786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:29.937296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-38e31849-dab5-400d-a2f4-f578a3028504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a551c537798a45898c35e506d6af0b5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:29.971266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 904/1815] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:29 2022] DELETE /identity/v3/users/a551c537798a45898c35e506d6af0b5e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:29.972925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:29.975923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b516-6e89-4c31-9b24-4a171407ac00 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:29.977102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:29.977569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.046413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] MFA Rules not processed for user `15d1d57f0c954a9dbfd969776b994862`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:30.047635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.076763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19afc8-e210-4820-8660-62e86ee9eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.079656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19afc8-e210-4820-8660-62e86ee9eed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.079793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19afc8-e210-4820-8660-62e86ee9eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.080005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19afc8-e210-4820-8660-62e86ee9eed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.080783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19afc8-e210-4820-8660-62e86ee9eed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.082503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19afc8-e210-4820-8660-62e86ee9eed8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.101470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 912/1816] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:30.103347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.104008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.104008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.153957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:30.155262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.164411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 913/1817] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:30.165279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.176056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e83dd-eee9-4d64-b976-3ab4b3f61d00 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.182235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.183024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.183304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.183632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] PATH_INFO: `/v3/projects/c0cbd6e440144d1eb5b08e8528f45ccd/users/300e974445114efab06e0ecf3fe081ff/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.210205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 905/1818] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:30.211667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.213092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbd6e440144d1eb5b08e8528f45ccd, user_id=300e974445114efab06e0ecf3fe081ff, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.221483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.221710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.292100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e5d69-3685-49ea-841b-25097d13383b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.297907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.298546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.298842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.299125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.310145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.313429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.323690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 906/1819] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:30.324533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.325922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.341138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc4799-9559-4826-9efe-eb496d20603f service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.347968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 914/1820] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:30 2022] PUT /identity/v3/projects/c0cbd6e440144d1eb5b08e8528f45ccd/users/300e974445114efab06e0ecf3fe081ff/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:30.348442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.456596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.457234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.457516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.457785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.458424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.460338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.467115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144119b4-e9a9-40c0-9650-cdd9d912b036 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.473992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.474550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.474829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.475103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.475753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.477999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.517001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 915/1821] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:30.518123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.541367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a804f-e6e2-46fc-a731-442f28155a1e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.555895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74772bf-f0be-46f7-9592-fb3bb8ada5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.557315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74772bf-f0be-46f7-9592-fb3bb8ada5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.557787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74772bf-f0be-46f7-9592-fb3bb8ada5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.558277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74772bf-f0be-46f7-9592-fb3bb8ada5a3 admin admin] PATH_INFO: `/v3/projects/c0cbd6e440144d1eb5b08e8528f45ccd/users/300e974445114efab06e0ecf3fe081ff/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.561132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74772bf-f0be-46f7-9592-fb3bb8ada5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbd6e440144d1eb5b08e8528f45ccd, user_id=300e974445114efab06e0ecf3fe081ff, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.564877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74772bf-f0be-46f7-9592-fb3bb8ada5a3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.576000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 916/1822] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:30 2022] PUT /identity/v3/projects/c0cbd6e440144d1eb5b08e8528f45ccd/users/300e974445114efab06e0ecf3fe081ff/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:30.588125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.588412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.588690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.604025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:30.619173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] MFA Rules not processed for user `300e974445114efab06e0ecf3fe081ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:30.621498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.648877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 907/1823] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:30 2022] POST /identity/v3/projects => generated 389 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:30.653365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.727229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 917/1824] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:30.739941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.741843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.757042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3280b91-9c50-4b6c-b175-fedb4b296449 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.769715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.770622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.771064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.772137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.784666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.787651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.836238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60a3f-d2e5-4bc6-8ada-bc99d2c4bf7b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.915264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.915897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.916181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.916453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.919143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:30.932862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 908/1825] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:30 2022] POST /identity/v3/users => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:30.936610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.949808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8156-f626-421b-85bb-7f6a9b53df21 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.955458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.956442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.956563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.956779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:30.957464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:30.959094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:30.970790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 909/1826] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:30.974841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:30.984735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c0627-0549-486d-b542-cc9c9de6e20c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:30.989607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:30.990260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:30.990546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:30.990820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] PATH_INFO: `/v3/projects/d142bb59141c41b492ff60aae1563b30/users/a183299146924df1be3882e23c82e992/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.006168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.006367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d142bb59141c41b492ff60aae1563b30, user_id=a183299146924df1be3882e23c82e992, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.007616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.008849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.017230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 918/1827] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:31.035822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:31.037804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:31.057949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dc279-9090-47f4-92f0-b8e237856c75 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:31.063407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:31.064382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.064639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.064983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] PATH_INFO: `/v3/projects/7a6c0440a9f74f88b6f6e159fe7976a1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.066718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6c0440a9f74f88b6f6e159fe7976a1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.071749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.192115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 910/1828] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:30 2022] PUT /identity/v3/projects/d142bb59141c41b492ff60aae1563b30/users/a183299146924df1be3882e23c82e992/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:31.198286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:31.237576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6c0440a9f74f88b6f6e159fe7976a1', 'request_id': 'req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:31.325566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345beaa8-1247-4ac5-94bc-7401c5783ba2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:31.374632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6c0440a9f74f88b6f6e159fe7976a1', 'request_id': 'req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:31.394467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6c0440a9f74f88b6f6e159fe7976a1', 'request_id': 'req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:31.442317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214bc43-504c-4523-b2a9-9d77f32c9b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:31.442317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bc43-504c-4523-b2a9-9d77f32c9b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.442317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bc43-504c-4523-b2a9-9d77f32c9b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.442317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bc43-504c-4523-b2a9-9d77f32c9b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.442690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214bc43-504c-4523-b2a9-9d77f32c9b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.442690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214bc43-504c-4523-b2a9-9d77f32c9b07 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.442832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] The token cache is being invalidate because project 7a6c0440a9f74f88b6f6e159fe7976a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:31.442832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:31.448452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:31.450775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 919/1829] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:31 2022] DELETE /identity/v3/projects/7a6c0440a9f74f88b6f6e159fe7976a1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:31.456338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 911/1830] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:31.461731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c38fba-e297-4d53-9b79-2168f000e39e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.462038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c38fba-e297-4d53-9b79-2168f000e39e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.462408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c38fba-e297-4d53-9b79-2168f000e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.465134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:31.468218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:31.498575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-61c38fba-e297-4d53-9b79-2168f000e39e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:31.501593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb729f-6dd4-4ef1-9396-39c5aa4cc901 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:31.507408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5002c-8d4f-4c13-acc4-1cd44dfbc1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:31.508875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5002c-8d4f-4c13-acc4-1cd44dfbc1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.509278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5002c-8d4f-4c13-acc4-1cd44dfbc1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.509555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5002c-8d4f-4c13-acc4-1cd44dfbc1c0 admin admin] PATH_INFO: `/v3/projects/d142bb59141c41b492ff60aae1563b30/users/a183299146924df1be3882e23c82e992/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.511861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-61c38fba-e297-4d53-9b79-2168f000e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:31.512648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5002c-8d4f-4c13-acc4-1cd44dfbc1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d142bb59141c41b492ff60aae1563b30, user_id=a183299146924df1be3882e23c82e992, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.517252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5002c-8d4f-4c13-acc4-1cd44dfbc1c0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.527179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 912/1831] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:31.527805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 920/1832] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:31 2022] PUT /identity/v3/projects/d142bb59141c41b492ff60aae1563b30/users/a183299146924df1be3882e23c82e992/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:31.538942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.539215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af03f-5297-4834-923c-12548b733682 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.539324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.539609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.540082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af03f-5297-4834-923c-12548b733682 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.540354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af03f-5297-4834-923c-12548b733682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.573245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:31.574572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:31.635570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e52af03f-5297-4834-923c-12548b733682 None None] MFA Rules not processed for user `a183299146924df1be3882e23c82e992`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:31.639934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e52af03f-5297-4834-923c-12548b733682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:31.711742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 913/1833] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:31.714123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:31.724001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae65b7-255f-46b9-a808-77bd11a9a244 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:31.730047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:31.733283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.733283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.733283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.733283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:31.733806 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.735672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.755820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 914/1834] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:31.759826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:31.777983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e7833-c656-4510-9a04-08b125129b6a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:31.786211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:31.787687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:31.788333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:31.788761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:31.789657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:31.792155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:31.804930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 921/1835] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:31.927685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af03f-5297-4834-923c-12548b733682 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:31.933553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e52af03f-5297-4834-923c-12548b733682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:31.963244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 915/1836] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:31 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:31.967610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:32.062143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af03f-5297-4834-923c-12548b733682 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.113918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07c82b-5aaf-420c-8e51-9d57a6f7cc9a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.119492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:32.127581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.127581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.127581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.128005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:32.128106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:32.128106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:32.162840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:32.163622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.163903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.164185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.250312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 916/1837] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:31 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:32.268719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:32.271538 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:32.273229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:32.279163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b097ba-a937-4249-a2c0-6c2e5b8f2c81 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.284236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:32.284842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.285115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.285435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.286076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:32.287670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:32.292553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 922/1838] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:32.300230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 917/1839] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:32.303940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:32.315100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f8fb-6472-4874-8ee3-519247010bb6 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.320814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:32.321442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.321715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.321980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.322608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:32.324333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:32.335066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 923/1840] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:32.339471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:32.351127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6663-db99-46e3-8539-ba41aefd2bde admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.356054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9accb-39e5-47ba-8d0a-5b8868652f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:32.356809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9accb-39e5-47ba-8d0a-5b8868652f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.360207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9accb-39e5-47ba-8d0a-5b8868652f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.360207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9accb-39e5-47ba-8d0a-5b8868652f52 admin admin] PATH_INFO: `/v3/projects/12f6cdbc21c24c0da6584b9187a82c5f/users/ced19102c5a546f3b6b44300f8a8c912/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.373672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9accb-39e5-47ba-8d0a-5b8868652f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f6cdbc21c24c0da6584b9187a82c5f, user_id=ced19102c5a546f3b6b44300f8a8c912, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:32.376940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9accb-39e5-47ba-8d0a-5b8868652f52 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:32.443513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:32.453812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e5f6-eab4-4ecd-a8ab-e11d2f1d067b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.458377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:32.458991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.459265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.459536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] PATH_INFO: `/v3/users/15d1d57f0c954a9dbfd969776b994862` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.460764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d1d57f0c954a9dbfd969776b994862)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:32.462699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:32.522332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 918/1841] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:32 2022] PUT /identity/v3/projects/12f6cdbc21c24c0da6584b9187a82c5f/users/ced19102c5a546f3b6b44300f8a8c912/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:32.534207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.534496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.534768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.580909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] MFA Rules not processed for user `ced19102c5a546f3b6b44300f8a8c912`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:32.582318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:32.711835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 919/1842] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:32.711835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:32.713223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:32.733076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d1d57f0c954a9dbfd969776b994862'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:32.735550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d1d57f0c954a9dbfd969776b994862'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:32.848765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d1d57f0c954a9dbfd969776b994862'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:32.867149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d1d57f0c954a9dbfd969776b994862'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:32.872634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-85b70abf-0ca2-41de-ac05-dddb7cb176cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d1d57f0c954a9dbfd969776b994862'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:32.910170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 924/1843] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:32 2022] DELETE /identity/v3/users/15d1d57f0c954a9dbfd969776b994862 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:32.915661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:32.915907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:32.916184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:32.925545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2feac0-ccd0-4f1a-8f80-44f71d57ffa4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:32.969848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:32.971161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:33.048328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.049732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.050024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.050295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.050995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.053098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.094456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 925/1844] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:33.109119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.111090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:33.177178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 920/1845] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:32 2022] POST /identity/v3/projects => generated 375 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:33.177429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bfab5-1185-4fb3-902a-f64b86d9d5bd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.178866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.180862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:33.227516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.227979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.228257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.228526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.268839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb748c63-aa35-497a-a96f-e4d46dae010a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.275306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.276242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.276709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.277348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.278227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.281340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.332322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.335086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.348174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 926/1846] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:33.387015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.388280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:33.408575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 921/1847] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:33 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:33.414326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.429870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9edc6-01f9-4752-b342-998d25a4cd8e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.434824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.435675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.435956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.436224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.437532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.440242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.453417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 922/1848] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:33.455439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.460057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4bbf0-706a-4ef3-a9fc-b5bbae81c919 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.465000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.465661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.465934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.466397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.466710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c545-f8a8-46a2-a4e3-6d052cd1450e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.469636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:33.480181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.480181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.480181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.480181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.480561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.480561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.493057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 923/1849] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:33.494172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.507821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6e44-a558-4012-b73a-a2b63cced201 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.514341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.514341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.514990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.515591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] PATH_INFO: `/v3/projects/8bd6f603249e425a9f97f241c1fa0f5f/users/4d9d74e9e0db4c18bfb0d775bc7f0e3c/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.548457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd6f603249e425a9f97f241c1fa0f5f, user_id=4d9d74e9e0db4c18bfb0d775bc7f0e3c, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.551508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.567093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.568562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b36a52-1b33-4eea-a89f-921e45d3497b service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:33.578606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 927/1850] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:33.659146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 924/1851] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:33 2022] PUT /identity/v3/projects/8bd6f603249e425a9f97f241c1fa0f5f/users/4d9d74e9e0db4c18bfb0d775bc7f0e3c/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:33.675534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.675806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.676071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.713662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] MFA Rules not processed for user `4d9d74e9e0db4c18bfb0d775bc7f0e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:33.715351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:33.783855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 928/1852] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:33.788221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:33.856465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6459-a4e2-454d-a6b6-828ee3320571 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:33.865669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:33.866073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:33.866352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:33.866620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:33.867299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:33.869490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.023728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.023728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:34.027818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 925/1853] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:33 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:34.032001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.047348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700b40-d08d-462f-8d5b-de45dd71dea9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.140449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c6325-2cf2-44d8-9363-7cada4f705d3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.146567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.147181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.147457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.147898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.148592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.148720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.150723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.153447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.153915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.155145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] PATH_INFO: `/v3/projects/73089c0e9a074964ba6df9ea856060c2` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.161234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73089c0e9a074964ba6df9ea856060c2)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.163208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.274876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 926/1854] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:34 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:34.278917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.289193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e024-f456-4e24-a48b-fe415b69ac1c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.293803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.294409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.294683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.294948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.295568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.297899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.308997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 927/1855] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:34.317251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.327536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73089c0e9a074964ba6df9ea856060c2', 'request_id': 'req-b78c3822-9d15-4449-a614-e6c53afecc06'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.327863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2c04d-f384-4f34-a8d5-96c4a511f0b5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.386167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.386826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.387103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.387372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] PATH_INFO: `/v3/projects/fc5309b344c2491cbe0ba39c0af3431c/users/4f3e98a8be834279bad3ba6b51f45fee/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.402770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73089c0e9a074964ba6df9ea856060c2', 'request_id': 'req-b78c3822-9d15-4449-a614-e6c53afecc06'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.407268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5309b344c2491cbe0ba39c0af3431c, user_id=4f3e98a8be834279bad3ba6b51f45fee, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.409966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73089c0e9a074964ba6df9ea856060c2', 'request_id': 'req-b78c3822-9d15-4449-a614-e6c53afecc06'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.417416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.421690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] The token cache is being invalidate because project 73089c0e9a074964ba6df9ea856060c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:34.421980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.422717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.424434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 929/1856] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:34 2022] DELETE /identity/v3/projects/73089c0e9a074964ba6df9ea856060c2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:34.428262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.429619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:34.443759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3822-9d15-4449-a614-e6c53afecc06 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.448355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.448956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.449262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.449542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] PATH_INFO: `/v3/users/a183299146924df1be3882e23c82e992` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.450667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a183299146924df1be3882e23c82e992)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.453297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.511587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 928/1857] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:34 2022] PUT /identity/v3/projects/fc5309b344c2491cbe0ba39c0af3431c/users/4f3e98a8be834279bad3ba6b51f45fee/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:34.515822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.517521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:34.581394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a25c-8223-46a3-be29-b372fc74cb41 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.586296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.596317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.596317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.596317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.596317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.596317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.600103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 929/1858] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:34.604368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.615735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fa4f2-5c7f-46fc-8c41-7d9a3c33e9f9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.630757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7c52-aafd-4e53-99f3-a02843d839f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.630757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7c52-aafd-4e53-99f3-a02843d839f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.630757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7c52-aafd-4e53-99f3-a02843d839f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.630757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7c52-aafd-4e53-99f3-a02843d839f5 admin admin] PATH_INFO: `/v3/projects/fc5309b344c2491cbe0ba39c0af3431c/users/4f3e98a8be834279bad3ba6b51f45fee/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.631168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f7c52-aafd-4e53-99f3-a02843d839f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5309b344c2491cbe0ba39c0af3431c, user_id=4f3e98a8be834279bad3ba6b51f45fee, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:34.633179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f7c52-aafd-4e53-99f3-a02843d839f5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:34.644321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 930/1859] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:34 2022] PUT /identity/v3/projects/fc5309b344c2491cbe0ba39c0af3431c/users/4f3e98a8be834279bad3ba6b51f45fee/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:34.654980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.655477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.655892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.667364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a183299146924df1be3882e23c82e992'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.668031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a183299146924df1be3882e23c82e992'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.692893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] MFA Rules not processed for user `4f3e98a8be834279bad3ba6b51f45fee`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:34.693713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:34.755088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a183299146924df1be3882e23c82e992'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.763639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a183299146924df1be3882e23c82e992'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.764862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a183299146924df1be3882e23c82e992'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:34.801299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 930/1860] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:34 2022] DELETE /identity/v3/users/a183299146924df1be3882e23c82e992 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:34.836834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 931/1861] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:34.852131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:34.859864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:34.968225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a1d3d-3ed4-4615-b6a9-8d9273636d26 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:34.977646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:34.978484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:34.978934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:34.979354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:34.985441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:35.097582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:35.099102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cda889-108b-4ff6-b0dd-53e1e1e74b92 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:35.111385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 931/1862] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:35.658295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:35.659982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:35.800190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee808aa7-bd21-4ef2-8bab-36407a0201ae None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:35.905964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:35.906876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:35.907292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:35.907632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] PATH_INFO: `/v3/projects/d142bb59141c41b492ff60aae1563b30` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:35.908864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d142bb59141c41b492ff60aae1563b30)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:35.911191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:35.991064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:36.107565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd142bb59141c41b492ff60aae1563b30', 'request_id': 'req-9894cea4-27c7-492b-a234-f763ec658a64'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:36.114453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd142bb59141c41b492ff60aae1563b30', 'request_id': 'req-9894cea4-27c7-492b-a234-f763ec658a64'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:36.243225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd142bb59141c41b492ff60aae1563b30', 'request_id': 'req-9894cea4-27c7-492b-a234-f763ec658a64'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:36.260234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] The token cache is being invalidate because project d142bb59141c41b492ff60aae1563b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:36.260525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:36.261733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9894cea4-27c7-492b-a234-f763ec658a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:36.265907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 932/1863] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:35 2022] DELETE /identity/v3/projects/d142bb59141c41b492ff60aae1563b30 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:36.270760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.271149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.271423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.295999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:36.297901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:36.371109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 932/1864] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:36.383953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.384232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.384504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.405854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:36.407085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:36.415155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 933/1865] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:36.419430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:36.429581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f20d9-4b72-49f9-9e83-74a7b47966c5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:36.434352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:36.434944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.435218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.435485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.436120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:36.436998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:36.439045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:36.450285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 933/1866] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:36.456153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:36.466003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36069349-eafd-406e-b568-83301cfd8d7d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:36.471523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:36.472141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.472412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.472681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.474696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:36.478138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:36.585063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 934/1867] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:36 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:36.589551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:36.601344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c32b6-33c2-4b5a-94f8-a1dab6c0abd8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:36.631398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:36.681927 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:36.682529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.682806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.683075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.683699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:36.685661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:36.780721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 934/1868] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:36 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:36.785472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:36.796484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373d4ff-6100-4cb4-8257-5b7702cf43bf admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:36.801607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:36.802310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.802584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.802853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.803489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:36.805171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:36.816789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 935/1869] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:36.820967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:36.831421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712ef3-467e-481a-9768-241ed885e5f8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:36.836190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5dc6-e948-4aba-a1b0-8e1a237fbced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:36.836787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5dc6-e948-4aba-a1b0-8e1a237fbced admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.837063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5dc6-e948-4aba-a1b0-8e1a237fbced admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.837369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5dc6-e948-4aba-a1b0-8e1a237fbced admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.838029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5dc6-e948-4aba-a1b0-8e1a237fbced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:36.839708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5dc6-e948-4aba-a1b0-8e1a237fbced admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:36.851962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 935/1870] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:36.856188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:36.866681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb0af-a216-4727-adde-4d0ae858dbd2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:36.871395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:36.872046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.872325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.872596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] PATH_INFO: `/v3/projects/994e415f91f94aed8f705a8be21f39eb/users/e6cda2b0797246b794ed0cd9570fa143/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:36.888970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=994e415f91f94aed8f705a8be21f39eb, user_id=e6cda2b0797246b794ed0cd9570fa143, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:36.891838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:36.976839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 936/1871] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:36 2022] PUT /identity/v3/projects/994e415f91f94aed8f705a8be21f39eb/users/e6cda2b0797246b794ed0cd9570fa143/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:36.997573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:36.998098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:36.998262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.038280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] MFA Rules not processed for user `e6cda2b0797246b794ed0cd9570fa143`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:37.039640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:37.104946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 936/1872] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:37.110106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:37.173419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58203-16a2-4980-86f2-1ebe3af0d3d6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:37.178348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:37.178957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:37.179237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:37.179510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.180148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:37.184945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:37.339818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:37.346967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 937/1873] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:37 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:37.350787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:37.361944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d458-05c9-4a7d-8b68-280ff7b00266 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:37.418571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:37.419176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:37.419449 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:37.419715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.420406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:37.423162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:37.548352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 937/1874] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:37 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:37.552200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:37.566346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca167b0-012b-40e7-8fb9-9d22e3fe897d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:37.574998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:37.576573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:37.577140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:37.577627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.579029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:37.580969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:37.595151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 938/1875] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:37.599419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:37.621356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986b092-f758-4018-945a-7d35b6ca83fd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:37.629413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f178b-6519-446c-b738-ade2103c618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:37.630160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f178b-6519-446c-b738-ade2103c618e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:37.630897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f178b-6519-446c-b738-ade2103c618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:37.630897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f178b-6519-446c-b738-ade2103c618e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.631343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f178b-6519-446c-b738-ade2103c618e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:37.633044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f178b-6519-446c-b738-ade2103c618e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:37.643636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 938/1876] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:37.647956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:37.657823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05468-cd31-4bec-b67c-9064ce6f912e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:37.662258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:37.662893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:37.663166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:37.663428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] PATH_INFO: `/v3/projects/5f8214547173499cb28799e7a4164396/users/36c173b2e2964970a2e1a370feeea4ac/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.679175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8214547173499cb28799e7a4164396, user_id=36c173b2e2964970a2e1a370feeea4ac, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:37.681938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:37.806556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 939/1877] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:37 2022] PUT /identity/v3/projects/5f8214547173499cb28799e7a4164396/users/36c173b2e2964970a2e1a370feeea4ac/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:37.817452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:37.818301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:37.818301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:37.850461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] MFA Rules not processed for user `36c173b2e2964970a2e1a370feeea4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:37.851812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:37.935354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 939/1878] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:37.940443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.003572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40629c7f-fc41-4e70-a20b-cd6192e284b4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.008196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.008799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.009073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.009388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.010054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.011972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.129678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 940/1879] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:37 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:38.131083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.143094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a48a-cbb7-4903-934f-6da7b0d02b89 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.205987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.205987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.205987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.205987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.206426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.207972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.326621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 940/1880] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:38 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:38.330562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.347296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97c20b-f37b-4b38-86b6-b97992b3786c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.353913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.354529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.354802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.355074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.356021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.366516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.378711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 941/1881] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:38.378937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.390249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0f283-607f-4dbf-9d83-130d7fe5f30a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.395559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.396218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.396494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.396758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] PATH_INFO: `/v3/projects/c07599c3794242cb96de8f78ab83d3af/users/31fb8a95f833401ba101473a84fd1336/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.412768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07599c3794242cb96de8f78ab83d3af, user_id=31fb8a95f833401ba101473a84fd1336, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.427850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.570577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 941/1882] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:38 2022] PUT /identity/v3/projects/c07599c3794242cb96de8f78ab83d3af/users/31fb8a95f833401ba101473a84fd1336/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:38.573976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.585252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad821fc-6130-424c-ae90-68a4111c3724 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.630548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.633862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:38.683717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.684361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.684634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.684903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.686093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.688359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.700083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 942/1883] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:38.704863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.716187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cd290-fd1c-4c1a-827d-426490fb725e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.717258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2113-2311-4973-9c6b-be7cfd5fbce6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:38.723539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.730152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.730152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.730152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.731004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7584597-07f9-4c5f-90b1-2967bed6f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:38.731741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7584597-07f9-4c5f-90b1-2967bed6f1de admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.732013 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7584597-07f9-4c5f-90b1-2967bed6f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.732546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7584597-07f9-4c5f-90b1-2967bed6f1de admin admin] PATH_INFO: `/v3/projects/c07599c3794242cb96de8f78ab83d3af/users/31fb8a95f833401ba101473a84fd1336/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.732793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:38.735148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7584597-07f9-4c5f-90b1-2967bed6f1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07599c3794242cb96de8f78ab83d3af, user_id=31fb8a95f833401ba101473a84fd1336, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.738071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7584597-07f9-4c5f-90b1-2967bed6f1de admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.748786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 943/1884] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:38 2022] PUT /identity/v3/projects/c07599c3794242cb96de8f78ab83d3af/users/31fb8a95f833401ba101473a84fd1336/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:38.759266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:38.759547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:38.759924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:38.793328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] MFA Rules not processed for user `31fb8a95f833401ba101473a84fd1336`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:38.794668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:38.800455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:38.801928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:38.812166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 942/1885] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:38.876258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 944/1886] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:38.932825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:38.934311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:38.948524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fcbf5-447d-4da1-afed-e3f5168c9643 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:39.000022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:39.000624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:39.000909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:39.001175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:39.011063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:39.012694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:39.023101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 943/1887] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:39.535119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:39.547652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1363bc-0768-4a2f-832a-f45183415721 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:39.551825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c35c4-0a91-419b-ab28-d016238a539a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:39.552433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c35c4-0a91-419b-ab28-d016238a539a service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:39.552706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c35c4-0a91-419b-ab28-d016238a539a service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:39.553132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c35c4-0a91-419b-ab28-d016238a539a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:39.621937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c35c4-0a91-419b-ab28-d016238a539a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:39.624561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c35c4-0a91-419b-ab28-d016238a539a service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:39.636758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 945/1888] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:39.909012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:39.910884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:40.015937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bc0b7-449e-41ab-9b6c-8ce12880c1d5 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:40.017959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:40.020243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:40.020644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:40.021729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] PATH_INFO: `/v3/users/cb396c112e3f4fd3834ff9d14abdec89` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:40.022544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb396c112e3f4fd3834ff9d14abdec89)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:40.024648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:40.295756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb396c112e3f4fd3834ff9d14abdec89'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:40.296414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb396c112e3f4fd3834ff9d14abdec89'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:40.368155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:40.402349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb396c112e3f4fd3834ff9d14abdec89'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:40.410963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb396c112e3f4fd3834ff9d14abdec89'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:40.411791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb396c112e3f4fd3834ff9d14abdec89'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:40.433843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 944/1889] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:39 2022] DELETE /identity/v3/users/cb396c112e3f4fd3834ff9d14abdec89 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:40.439384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:40.444890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:40.444890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:40.458457 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:40.459587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:40.523245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 946/1890] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:40.534539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:40.535682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:40.606678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facb6c9-122f-410b-ad70-c16343b50a47 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:40.610426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:40.611042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:40.611316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:40.611641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:40.622011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:40.623467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:40.633942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 945/1891] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:40.952571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:41.134238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:41.134238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:41.206336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ac17a-991e-4961-9067-2b53ce9473a2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:41.210130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:41.210840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:41.211174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:41.211510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:41.213846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:41.311663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:41.315366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:41.358226 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092438f-8d18-4041-8509-df5e99f0de12 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:41.371432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:41.373953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:41.374270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:41.374533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] PATH_INFO: `/v3/projects/044e2480073d452eaf281da5b9da256c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:41.377022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=044e2480073d452eaf281da5b9da256c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:41.377561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:41.380852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:41.383116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:41.423368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 947/1892] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:41.593983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044e2480073d452eaf281da5b9da256c', 'request_id': 'req-c1150cd2-7318-4604-8d06-ed2f5481c03f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:41.697693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044e2480073d452eaf281da5b9da256c', 'request_id': 'req-c1150cd2-7318-4604-8d06-ed2f5481c03f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:41.704780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044e2480073d452eaf281da5b9da256c', 'request_id': 'req-c1150cd2-7318-4604-8d06-ed2f5481c03f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:41.731040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] The token cache is being invalidate because project 044e2480073d452eaf281da5b9da256c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:41.732399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:41.734340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:41.738567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 946/1893] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:41 2022] DELETE /identity/v3/projects/044e2480073d452eaf281da5b9da256c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:41.741590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:41.759114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c18a-f783-4d88-b15b-4f982ef6baa5 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:41.850480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:41.851150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:41.851431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:41.851701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] PATH_INFO: `/v3/users/300e974445114efab06e0ecf3fe081ff` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:41.853931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300e974445114efab06e0ecf3fe081ff)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:41.856723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:42.137586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300e974445114efab06e0ecf3fe081ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:42.142337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300e974445114efab06e0ecf3fe081ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:42.143308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300e974445114efab06e0ecf3fe081ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:42.151647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300e974445114efab06e0ecf3fe081ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:42.272178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40b14fca-eaee-4c6e-83e4-16a014b5d3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300e974445114efab06e0ecf3fe081ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:42.307394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 948/1894] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:41 2022] DELETE /identity/v3/users/300e974445114efab06e0ecf3fe081ff => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:42.935873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:42.942062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:42.972546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:42.979870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1150cd2-7318-4604-8d06-ed2f5481c03f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:43.055975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:43.056503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:43.056783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:43.057056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] PATH_INFO: `/v3/projects/c0cbd6e440144d1eb5b08e8528f45ccd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:43.058241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cbd6e440144d1eb5b08e8528f45ccd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:43.060206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:43.212266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cbd6e440144d1eb5b08e8528f45ccd', 'request_id': 'req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:43.353898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cbd6e440144d1eb5b08e8528f45ccd', 'request_id': 'req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:43.360418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cbd6e440144d1eb5b08e8528f45ccd', 'request_id': 'req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:43.371364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] The token cache is being invalidate because project c0cbd6e440144d1eb5b08e8528f45ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:43.371649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:43.372290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5226ae3d-7d73-41b4-acd0-fa9e5810d07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:43.374413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 947/1895] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:42 2022] DELETE /identity/v3/projects/c0cbd6e440144d1eb5b08e8528f45ccd => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:43.379296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:43.379767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:43.379856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:43.399278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:43.400491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:43.464177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 949/1896] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:43.472502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:43.472785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:43.473075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:43.493856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:43.495081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:43.503825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 948/1897] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:43.512809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:43.523136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4d5-65d9-4553-97c0-6119d44c6ddc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:43.528179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:43.528776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:43.529051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:43.529357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:43.530137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:43.530668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:43.532344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:43.547995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 950/1898] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:43.550036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:43.562019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb792f7-7db5-4b6c-84f8-1287c7941ac0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:43.585360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:43.585360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:43.585360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:43.585360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:43.587054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:43.587054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:43.763219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 949/1899] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:43 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:43.767189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:43.777444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867d29d-79c2-4ef1-ba78-470b64eeea5a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:43.867387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:43.868285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:43.868747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:43.870053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:43.870905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:43.874056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:43.991535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 951/1900] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:43 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:44.007624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.022469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7b07-2ceb-41f7-a67b-395c0d310153 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.027822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.028426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.028706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.028976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.029652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.031658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.042197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 950/1901] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:44.047901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.066744 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37613-a8bf-4a6f-a9c5-3d7c6863de5e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.071783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141fb06-0a97-4cc7-9d2d-e874607557cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.072395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fb06-0a97-4cc7-9d2d-e874607557cd admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.072670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fb06-0a97-4cc7-9d2d-e874607557cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.072935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fb06-0a97-4cc7-9d2d-e874607557cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.073625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141fb06-0a97-4cc7-9d2d-e874607557cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.075209 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141fb06-0a97-4cc7-9d2d-e874607557cd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.086691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 952/1902] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:44.091171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.107212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b35f9b-23ee-4403-b915-e1b59698718e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.113860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.114443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.115038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.115322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] PATH_INFO: `/v3/projects/45cc716f64d44f60a3047f9af98846f9/users/fbe3cadf9b7041ed8449629f4951b07a/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.134882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cc716f64d44f60a3047f9af98846f9, user_id=fbe3cadf9b7041ed8449629f4951b07a, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.137628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.270567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 951/1903] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:44 2022] PUT /identity/v3/projects/45cc716f64d44f60a3047f9af98846f9/users/fbe3cadf9b7041ed8449629f4951b07a/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:44.284587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.284871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.285145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.296760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:44.323307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] MFA Rules not processed for user `fbe3cadf9b7041ed8449629f4951b07a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:44.329926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:44.401713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 953/1904] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:44.406242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.475838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e869c2f-a478-46f2-9e19-68eda52333d4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.486628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.487363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.487763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.490626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.491301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.493259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.622058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 952/1905] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:44 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:44.626337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.637673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330199-a20b-4cbf-bee0-b8cc87b14c13 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.701882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.704996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:44.707872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.708661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.709019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.709413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.710425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.712769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.724893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe0e39-2865-498f-a67a-7411d2e596fd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.731967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.742027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.742361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.748264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] PATH_INFO: `/v3/users/4880b94232c74cf493cc13b5ea6423a3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.750770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4880b94232c74cf493cc13b5ea6423a3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.752865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.861131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 954/1906] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:44 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:44.865098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.875787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a665c22-3ae6-4a1f-86de-da23e4cd8659 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.880738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.881393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.881678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.881970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.882612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.884377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:44.901144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 955/1907] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:44.904607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:44.915905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dca3d-3c11-413f-a3e0-c8b96a1e536d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:44.923040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:44.923824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:44.924324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:44.924815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] PATH_INFO: `/v3/projects/d4d1397b8ba94216a7c1db52286b2f08/users/57507672cc7a4e3bb11e3d0598b5867c/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:44.943837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d1397b8ba94216a7c1db52286b2f08, user_id=57507672cc7a4e3bb11e3d0598b5867c, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:44.946750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.072749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 956/1908] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:44 2022] PUT /identity/v3/projects/d4d1397b8ba94216a7c1db52286b2f08/users/57507672cc7a4e3bb11e3d0598b5867c/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:45.077156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.086487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4880b94232c74cf493cc13b5ea6423a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.087177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4880b94232c74cf493cc13b5ea6423a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.151874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0067-02ea-4cc8-bc61-e49bee958ca4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:45.157828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:45.158445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.158722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.159053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.159695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:45.161908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.171492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 957/1909] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:45.175516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.185348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3246ac-a940-4825-a5cd-32063449ed9d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:45.190588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c3fbc-1dcb-4b4f-8426-f04da1ae76a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:45.191385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3fbc-1dcb-4b4f-8426-f04da1ae76a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.196242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3fbc-1dcb-4b4f-8426-f04da1ae76a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.196242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3fbc-1dcb-4b4f-8426-f04da1ae76a4 admin admin] PATH_INFO: `/v3/projects/d4d1397b8ba94216a7c1db52286b2f08/users/57507672cc7a4e3bb11e3d0598b5867c/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.196242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c3fbc-1dcb-4b4f-8426-f04da1ae76a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d1397b8ba94216a7c1db52286b2f08, user_id=57507672cc7a4e3bb11e3d0598b5867c, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:45.196915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c3fbc-1dcb-4b4f-8426-f04da1ae76a4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.210431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 958/1910] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:45 2022] PUT /identity/v3/projects/d4d1397b8ba94216a7c1db52286b2f08/users/57507672cc7a4e3bb11e3d0598b5867c/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:45.221617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d39e-ffb9-4742-82a4-e719e82406a8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.221908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d39e-ffb9-4742-82a4-e719e82406a8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.222183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d39e-ffb9-4742-82a4-e719e82406a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.231148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4880b94232c74cf493cc13b5ea6423a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.239295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4880b94232c74cf493cc13b5ea6423a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.239989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4880b94232c74cf493cc13b5ea6423a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.254394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0f46d39e-ffb9-4742-82a4-e719e82406a8 None None] MFA Rules not processed for user `57507672cc7a4e3bb11e3d0598b5867c`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:45.255677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0f46d39e-ffb9-4742-82a4-e719e82406a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.261703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 953/1911] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:44 2022] DELETE /identity/v3/users/4880b94232c74cf493cc13b5ea6423a3 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:45.265030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.265196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.336626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 959/1912] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:45.337505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.337884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.338000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4106b-4da0-4647-8a90-72f3383eccb4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:45.338156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.344799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:45.345841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.346310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.346737 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] PATH_INFO: `/v3/users/e6cda2b0797246b794ed0cd9570fa143` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.348114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6cda2b0797246b794ed0cd9570fa143)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:45.350128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.360023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:45.361389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.369288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 960/1913] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:45.370081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.376505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.430882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6f2e2-6cc3-4c49-9dfb-88e6bb55c9ad None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:45.434764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:45.435369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.435658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.436750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.498345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:45.500474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.510786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 961/1914] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:45.512757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.514877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.574519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:45.594561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142efe65-bbaa-4006-b5a3-34cda8753264 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:45.598621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:45.599238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.601022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.601022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.610047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:45.611496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.625572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 962/1915] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:45.626897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.630915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.644991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96dead-d353-44ef-8a58-faf2ebfd9ca4 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:45.650020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:45.650874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.651251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.651645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] PATH_INFO: `/v3/users/fbe3cadf9b7041ed8449629f4951b07a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.653316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe3cadf9b7041ed8449629f4951b07a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:45.655416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:45.679509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6cda2b0797246b794ed0cd9570fa143'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.680496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6cda2b0797246b794ed0cd9570fa143'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.800786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6cda2b0797246b794ed0cd9570fa143'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.810693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6cda2b0797246b794ed0cd9570fa143'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.811685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-81b3a2ad-93f9-43d5-9c95-c4ff1c330031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6cda2b0797246b794ed0cd9570fa143'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.836110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 954/1916] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:45 2022] DELETE /identity/v3/users/e6cda2b0797246b794ed0cd9570fa143 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:45.838485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:45.838860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:45.839225 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:45.876655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:45.877915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:45.922975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe3cadf9b7041ed8449629f4951b07a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.923666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe3cadf9b7041ed8449629f4951b07a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.924331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe3cadf9b7041ed8449629f4951b07a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.934351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe3cadf9b7041ed8449629f4951b07a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:45.944246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 955/1917] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:45.962198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:45.963882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:46.011243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c50612ee-b5eb-4319-b296-325b4efc0ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe3cadf9b7041ed8449629f4951b07a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:46.044288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa4cf-f651-4f04-be97-1c974bf20578 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:46.046584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 963/1918] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:45 2022] DELETE /identity/v3/users/fbe3cadf9b7041ed8449629f4951b07a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:46.051161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:46.051619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:46.051940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:46.099816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:46.101249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:46.112345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:46.116517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:46.116517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:46.116517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:46.198270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 964/1919] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:46.199142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:46.200435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:46.206891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:46.208645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:46.219358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585b89-6a40-4e8e-a63a-24fc8236d3f1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:46.221971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 956/1920] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:46.222811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:46.231645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac4a2-aa6b-4fc7-b23f-5095cc09218a service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:46.236547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:46.236850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:46.237310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:46.237684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:46.243843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:46.244823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:46.245664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:46.246313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] PATH_INFO: `/v3/projects/d374c56641724f7890861f8f3cb505cf` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:46.248037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:46.249321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d374c56641724f7890861f8f3cb505cf)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:46.250832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:46.251296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:46.264943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 957/1921] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:46.450633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd374c56641724f7890861f8f3cb505cf', 'request_id': 'req-d839abfe-0e0e-48e4-aad9-fa13b039433e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:46.458620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd374c56641724f7890861f8f3cb505cf', 'request_id': 'req-d839abfe-0e0e-48e4-aad9-fa13b039433e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:46.465702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:46.725850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd374c56641724f7890861f8f3cb505cf', 'request_id': 'req-d839abfe-0e0e-48e4-aad9-fa13b039433e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:46.741594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] The token cache is being invalidate because project d374c56641724f7890861f8f3cb505cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:46.742114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:46.742775 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:46.745004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 965/1922] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:46 2022] DELETE /identity/v3/projects/d374c56641724f7890861f8f3cb505cf => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:46.750080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:46.760621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3681b-aa7f-4d0b-92b7-7b17015556f1 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:46.842288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:46.842288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:46.842288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:46.842288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] PATH_INFO: `/v3/users/cdc78022d03d4efdb1fd197e6b16dd0e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:46.842591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc78022d03d4efdb1fd197e6b16dd0e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:46.842591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:46.998936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:47.001274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:47.034059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839abfe-0e0e-48e4-aad9-fa13b039433e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:47.039990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:47.040821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:47.041484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:47.041885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] PATH_INFO: `/v3/projects/994e415f91f94aed8f705a8be21f39eb` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:47.043439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=994e415f91f94aed8f705a8be21f39eb)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:47.045887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:47.166261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc78022d03d4efdb1fd197e6b16dd0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.167274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc78022d03d4efdb1fd197e6b16dd0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.172377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994e415f91f94aed8f705a8be21f39eb', 'request_id': 'req-0e8c9d67-3795-4a16-870f-b080b98a0ce3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.177935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994e415f91f94aed8f705a8be21f39eb', 'request_id': 'req-0e8c9d67-3795-4a16-870f-b080b98a0ce3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.325885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc78022d03d4efdb1fd197e6b16dd0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.333450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc78022d03d4efdb1fd197e6b16dd0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.334141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc78022d03d4efdb1fd197e6b16dd0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.354104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 958/1923] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:46 2022] DELETE /identity/v3/users/cdc78022d03d4efdb1fd197e6b16dd0e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:47.355248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:47.356647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:47.423602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c515c5-1d17-46dc-9d65-c7b6c337d3a0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:47.429104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:47.429890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:47.430887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:47.430887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] PATH_INFO: `/v3/projects/45cc716f64d44f60a3047f9af98846f9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:47.431808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cc716f64d44f60a3047f9af98846f9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:47.434054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:47.465127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994e415f91f94aed8f705a8be21f39eb', 'request_id': 'req-0e8c9d67-3795-4a16-870f-b080b98a0ce3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.479015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] The token cache is being invalidate because project 994e415f91f94aed8f705a8be21f39eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:47.479123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.479762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.481404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 966/1924] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:46 2022] DELETE /identity/v3/projects/994e415f91f94aed8f705a8be21f39eb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:47.486016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:47.487356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:47.556243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9d67-3795-4a16-870f-b080b98a0ce3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:47.561006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:47.561809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:47.563351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:47.563351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] PATH_INFO: `/v3/users/36c173b2e2964970a2e1a370feeea4ac` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:47.564121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c173b2e2964970a2e1a370feeea4ac)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:47.566092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:47.590937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cc716f64d44f60a3047f9af98846f9', 'request_id': 'req-aa431978-816b-4ce7-aceb-3d150e2eb406'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.671687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cc716f64d44f60a3047f9af98846f9', 'request_id': 'req-aa431978-816b-4ce7-aceb-3d150e2eb406'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.682496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cc716f64d44f60a3047f9af98846f9', 'request_id': 'req-aa431978-816b-4ce7-aceb-3d150e2eb406'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.698804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] The token cache is being invalidate because project 45cc716f64d44f60a3047f9af98846f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:47.699119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.699895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.704937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 959/1925] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:47 2022] DELETE /identity/v3/projects/45cc716f64d44f60a3047f9af98846f9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:47.706127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:47.710040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:47.783385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa431978-816b-4ce7-aceb-3d150e2eb406 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:47.788786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:47.789598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:47.789957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:47.790547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] PATH_INFO: `/v3/users/57507672cc7a4e3bb11e3d0598b5867c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:47.790771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c173b2e2964970a2e1a370feeea4ac'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.791452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c173b2e2964970a2e1a370feeea4ac'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.791951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57507672cc7a4e3bb11e3d0598b5867c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:47.792058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c173b2e2964970a2e1a370feeea4ac'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.794213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:47.805781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c173b2e2964970a2e1a370feeea4ac'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.885113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c173b2e2964970a2e1a370feeea4ac'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:47.907963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 967/1926] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:47 2022] DELETE /identity/v3/users/36c173b2e2964970a2e1a370feeea4ac => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:47.908848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:47.910283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:47.991526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4272-de16-4e18-8def-157fdf001bc9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:47.997417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:47.998101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:47.998383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:47.998654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] PATH_INFO: `/v3/projects/080339901d74477fa2524b1764c4941e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.000354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=080339901d74477fa2524b1764c4941e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.002769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.034525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57507672cc7a4e3bb11e3d0598b5867c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.034872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57507672cc7a4e3bb11e3d0598b5867c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.119886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57507672cc7a4e3bb11e3d0598b5867c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.128882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57507672cc7a4e3bb11e3d0598b5867c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.129617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57507672cc7a4e3bb11e3d0598b5867c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.140310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080339901d74477fa2524b1764c4941e', 'request_id': 'req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.147281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080339901d74477fa2524b1764c4941e', 'request_id': 'req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.150794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 960/1927] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:47 2022] DELETE /identity/v3/users/57507672cc7a4e3bb11e3d0598b5867c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:48.154395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.156078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.222679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080339901d74477fa2524b1764c4941e', 'request_id': 'req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.236323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5548e3d-c0b5-4630-9f88-75ed1cc28cc8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.238331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] The token cache is being invalidate because project 080339901d74477fa2524b1764c4941e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:48.238667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.239328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fbf49b1b-939f-4c50-9a9a-8a322f9715ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.242551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.243122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.243398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.243661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] PATH_INFO: `/v3/users/ced19102c5a546f3b6b44300f8a8c912` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.244330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 968/1928] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:47 2022] DELETE /identity/v3/projects/080339901d74477fa2524b1764c4941e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:48.244989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced19102c5a546f3b6b44300f8a8c912)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.246324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19589ed5-2561-49bc-92cd-5dcfbfeedf52 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.246324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19589ed5-2561-49bc-92cd-5dcfbfeedf52 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.246703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19589ed5-2561-49bc-92cd-5dcfbfeedf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.254344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.270705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-19589ed5-2561-49bc-92cd-5dcfbfeedf52 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:48.271959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-19589ed5-2561-49bc-92cd-5dcfbfeedf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.281937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 969/1929] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:48.289438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.289723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.289995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.309526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:48.310745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.319173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 970/1930] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:48.323183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.332635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919204f-68d6-4412-9e85-cb87209c4369 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.337197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.337741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.338017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.338283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.338906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:48.339208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.340927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.352640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 971/1931] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:46:48.356900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.366803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0031fe1-c9e8-407e-b4e0-56681debc51f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.371546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.372965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.373089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.373360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.373984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.376496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.461088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced19102c5a546f3b6b44300f8a8c912'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.461458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced19102c5a546f3b6b44300f8a8c912'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.542148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 972/1932] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:48 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:48.542148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.542148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.559771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced19102c5a546f3b6b44300f8a8c912'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.567592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced19102c5a546f3b6b44300f8a8c912'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.568239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced19102c5a546f3b6b44300f8a8c912'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.586329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 961/1933] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:48 2022] DELETE /identity/v3/users/ced19102c5a546f3b6b44300f8a8c912 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:48.587156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.590870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.609886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a40e-e786-483c-ad44-f97f08b9f06e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.662278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8291-05b4-4cf9-a67d-ae09aa8236c9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.668807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c1ea2-51f7-4b9a-8b5d-39471ad67c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.669461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1ea2-51f7-4b9a-8b5d-39471ad67c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.669731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1ea2-51f7-4b9a-8b5d-39471ad67c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.670003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1ea2-51f7-4b9a-8b5d-39471ad67c4c admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.670631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c1ea2-51f7-4b9a-8b5d-39471ad67c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.679753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c1ea2-51f7-4b9a-8b5d-39471ad67c4c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.681608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.682329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.682608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.682881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] PATH_INFO: `/v3/projects/5f8214547173499cb28799e7a4164396` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.684132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8214547173499cb28799e7a4164396)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.686407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.785378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 962/1934] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:48 2022] POST /identity/v3/users => generated 282 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:48.787214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.787623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.788391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.830551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:48.831711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8214547173499cb28799e7a4164396', 'request_id': 'req-725d1c42-3fef-4fdc-b85b-434a4c6699de'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.832788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.847967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8214547173499cb28799e7a4164396', 'request_id': 'req-725d1c42-3fef-4fdc-b85b-434a4c6699de'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.919423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8214547173499cb28799e7a4164396', 'request_id': 'req-725d1c42-3fef-4fdc-b85b-434a4c6699de'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.924698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 963/1935] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:48.930066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.940539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.941178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:48.946568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] The token cache is being invalidate because project 5f8214547173499cb28799e7a4164396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:48.946891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.947610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:48.950121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 973/1936] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:48 2022] DELETE /identity/v3/projects/5f8214547173499cb28799e7a4164396 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:48.950925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:48.954056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:48.955825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8af5cd-3fde-4a9b-bea5-132f730a6cd8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.961187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.961803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.962081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.962358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] PATH_INFO: `/v3/projects/d4d1397b8ba94216a7c1db52286b2f08` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.963592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d1397b8ba94216a7c1db52286b2f08)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.965814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:48.969634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1c42-3fef-4fdc-b85b-434a4c6699de admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:48.981994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:48.983446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:48.985948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:48.986384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:48.987224 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:48.990486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.011264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 974/1937] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:49.011264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.011264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.075238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a981-e4ea-4c45-985f-7c3bacea54f2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.086975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d1397b8ba94216a7c1db52286b2f08', 'request_id': 'req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.133329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.133864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.134140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.134413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.136148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.170825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d1397b8ba94216a7c1db52286b2f08', 'request_id': 'req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.179679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d1397b8ba94216a7c1db52286b2f08', 'request_id': 'req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.193165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] The token cache is being invalidate because project d4d1397b8ba94216a7c1db52286b2f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:49.194764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.194764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.195845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 964/1938] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:48 2022] DELETE /identity/v3/projects/d4d1397b8ba94216a7c1db52286b2f08 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:49.197001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.198278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.213945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.215437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.219315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e91fd5-9ae0-4d21-bdbb-d1c610b35e8b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.223123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.223755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.224077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.224314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] PATH_INFO: `/v3/users/31fb8a95f833401ba101473a84fd1336` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.224314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fb8a95f833401ba101473a84fd1336)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.227643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.229590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 975/1939] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:49.230445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.243007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907c62a-56fa-48df-969f-0b9905f602fe service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.249826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf2a9b-dfb3-4e2a-a171-5e15e297a50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.250443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2a9b-dfb3-4e2a-a171-5e15e297a50f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.250724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2a9b-dfb3-4e2a-a171-5e15e297a50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.250990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2a9b-dfb3-4e2a-a171-5e15e297a50f admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.251633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf2a9b-dfb3-4e2a-a171-5e15e297a50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.253944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf2a9b-dfb3-4e2a-a171-5e15e297a50f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.271954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 976/1940] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:49.271954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.271954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.271954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.293062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:49.294332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.307713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 977/1941] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:49.308847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.310692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.328176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df54b-cb29-4b51-a267-2b8d44774b53 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.330273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9d0f-d2a3-422e-816d-edb223578cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.331232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9d0f-d2a3-422e-816d-edb223578cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.331232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9d0f-d2a3-422e-816d-edb223578cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.331450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9d0f-d2a3-422e-816d-edb223578cf9 admin admin] PATH_INFO: `/v3/projects/533972065a0245bca8a536895a129bac/users/7fd0d798f02f4385807f4f6ce2c05dd9/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.350130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9d0f-d2a3-422e-816d-edb223578cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533972065a0245bca8a536895a129bac, user_id=7fd0d798f02f4385807f4f6ce2c05dd9, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.353034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9d0f-d2a3-422e-816d-edb223578cf9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.490903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 978/1942] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:49 2022] PUT /identity/v3/projects/533972065a0245bca8a536895a129bac/users/7fd0d798f02f4385807f4f6ce2c05dd9/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:49.492518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68dae6-777d-4f5e-9cad-1a0a0770a814 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.492944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68dae6-777d-4f5e-9cad-1a0a0770a814 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.493246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68dae6-777d-4f5e-9cad-1a0a0770a814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.516356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fb8a95f833401ba101473a84fd1336'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.517232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fb8a95f833401ba101473a84fd1336'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.518778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8b68dae6-777d-4f5e-9cad-1a0a0770a814 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:49.520819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8b68dae6-777d-4f5e-9cad-1a0a0770a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.599757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fb8a95f833401ba101473a84fd1336'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.608073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 979/1943] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:49.610595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.611942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.612622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.614147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fb8a95f833401ba101473a84fd1336'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.615129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fb8a95f833401ba101473a84fd1336'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:49.631652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:49.652687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 965/1944] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:49 2022] DELETE /identity/v3/users/31fb8a95f833401ba101473a84fd1336 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:49.653661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.655060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.664105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] MFA Rules not processed for user `7fd0d798f02f4385807f4f6ce2c05dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:49.670669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.778185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93df68-5a95-4252-a0a3-573cef72b6ae admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.784545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 980/1945] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:49.788148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.788148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.788148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.788148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.788632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:49.788632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.789666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.790199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.791730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:49.804124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 966/1946] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:49.807711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883d6df-0fe8-4cc7-8e5a-9a9f72f6346d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.808401 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.812483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.813086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.813514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.813789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.814435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.816516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.821741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdc316-89db-46ff-a841-9d0a1e3343c2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:49.828224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:49.828827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:49.829135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:49.829454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:49.830020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:49.831939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:49.979882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 981/1947] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:49 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:49.980530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:49.985441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:50.016784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 967/1948] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:49 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:50.017652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.071114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5002-f28f-4056-8325-8d0e7e440ea5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.107795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42422010-1757-4b72-b709-7ea287bac3de admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.113506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.114387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.114804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.115380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.116246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.118622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.168558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.169726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.170627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.171695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] PATH_INFO: `/v3/projects/12f6cdbc21c24c0da6584b9187a82c5f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.173817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f6cdbc21c24c0da6584b9187a82c5f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.179765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.289377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 968/1949] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:50 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:50.290202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.304295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33d38-1955-4f18-8a8d-bd90496b5d70 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.325091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.325678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.325959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.331383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.331383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.331383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.393530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f6cdbc21c24c0da6584b9187a82c5f', 'request_id': 'req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.399079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f6cdbc21c24c0da6584b9187a82c5f', 'request_id': 'req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.479965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 969/1950] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:50 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:50.481286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.501041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172dc2-232e-441e-b46b-9e03265acb71 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.558926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.559756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.560208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.560595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.561728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.563346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.573835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 970/1951] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:50.574633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.576533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:50.577122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f6cdbc21c24c0da6584b9187a82c5f', 'request_id': 'req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.589150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517857ec-b281-4a03-bcd3-3ecd573d9ac1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.590356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] The token cache is being invalidate because project 12f6cdbc21c24c0da6584b9187a82c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:50.598691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.598691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.598691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 982/1952] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:49 2022] DELETE /identity/v3/projects/12f6cdbc21c24c0da6584b9187a82c5f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:50.598691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.599144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.599144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.599144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.599368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:50.599439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] PATH_INFO: `/v3/projects/c07599c3794242cb96de8f78ab83d3af` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.599439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07599c3794242cb96de8f78ab83d3af)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.599439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.608592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc45bc-f534-40e1-b3db-8d66aaf722c9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.614564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.615228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.615463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.615732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.616378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.618006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.629466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 983/1953] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:50.630264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.632003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:50.650261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833adc-b653-44ff-a6a3-a9274926dbe4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.654881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.655533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.655996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.656431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] PATH_INFO: `/v3/projects/66f0a33f1aeb4c35ba51c2716991f0c8/users/70bf10f23e7846d9b3d9de0440f0d297/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.679104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f0a33f1aeb4c35ba51c2716991f0c8, user_id=70bf10f23e7846d9b3d9de0440f0d297, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.679104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.807557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 984/1954] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:50 2022] PUT /identity/v3/projects/66f0a33f1aeb4c35ba51c2716991f0c8/users/70bf10f23e7846d9b3d9de0440f0d297/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:50.808489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.812314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:50.824601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07599c3794242cb96de8f78ab83d3af', 'request_id': 'req-f62f3402-0f69-4969-be1b-a2495249ffd9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.880112 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db5028-e0a8-486e-bfb5-e26a6c9a8b84 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.896986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07599c3794242cb96de8f78ab83d3af', 'request_id': 'req-f62f3402-0f69-4969-be1b-a2495249ffd9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.903372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07599c3794242cb96de8f78ab83d3af', 'request_id': 'req-f62f3402-0f69-4969-be1b-a2495249ffd9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.915486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] The token cache is being invalidate because project c07599c3794242cb96de8f78ab83d3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:50.915767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.916399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:50.918042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 971/1955] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:50 2022] DELETE /identity/v3/projects/c07599c3794242cb96de8f78ab83d3af => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:50.918929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:50.920189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:50.939451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.940004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.940280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.940549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] PATH_INFO: `/v3/users/4d9d74e9e0db4c18bfb0d775bc7f0e3c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.941704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9d74e9e0db4c18bfb0d775bc7f0e3c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.943660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:50.987602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3402-0f69-4969-be1b-a2495249ffd9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:50.992362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:50.992962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:50.993267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:50.993535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:50.994228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:50.995808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.005850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 972/1956] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:51.006623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.009852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.023026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b72c-f123-4dc5-b456-43a9aac1cc2c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.027655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740719b-a612-4a9f-b3f0-76d6b585fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.028241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740719b-a612-4a9f-b3f0-76d6b585fd9d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.028518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740719b-a612-4a9f-b3f0-76d6b585fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.028889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740719b-a612-4a9f-b3f0-76d6b585fd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.030006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740719b-a612-4a9f-b3f0-76d6b585fd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.031724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740719b-a612-4a9f-b3f0-76d6b585fd9d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.041589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 973/1957] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:51.042932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.043159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.043383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.063661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:51.064864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.072908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 974/1958] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:51.073727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.083850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815aa82-d314-404c-9c5e-5bac2766469c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.088357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.088991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.089293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.089561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] PATH_INFO: `/v3/projects/dfae00ce13ec439db2637eb398dbae6f/users/ee5ebf51c98e42888492c5d4bc53cdab/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.105427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfae00ce13ec439db2637eb398dbae6f, user_id=ee5ebf51c98e42888492c5d4bc53cdab, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.108304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.147791 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:51.160797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9d74e9e0db4c18bfb0d775bc7f0e3c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:51.161465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9d74e9e0db4c18bfb0d775bc7f0e3c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:51.162061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9d74e9e0db4c18bfb0d775bc7f0e3c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:51.168979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9d74e9e0db4c18bfb0d775bc7f0e3c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:51.208341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 975/1959] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:51 2022] PUT /identity/v3/projects/dfae00ce13ec439db2637eb398dbae6f/users/ee5ebf51c98e42888492c5d4bc53cdab/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:51.209380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.211149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.241895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-34efa9e7-0616-4a5c-9f98-98b983fb6750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9d74e9e0db4c18bfb0d775bc7f0e3c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:51.269906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 985/1960] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:50 2022] DELETE /identity/v3/users/4d9d74e9e0db4c18bfb0d775bc7f0e3c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:51.291708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c85b9-ef91-4c07-b42c-836f6611201b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.291708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c85b9-ef91-4c07-b42c-836f6611201b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.291708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c85b9-ef91-4c07-b42c-836f6611201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.296752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-805c85b9-ef91-4c07-b42c-836f6611201b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:51.298068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-805c85b9-ef91-4c07-b42c-836f6611201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.307973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50954-ff59-468d-a97c-4a585fb8fa94 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.394120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.395063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.395440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.395814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] PATH_INFO: `/v3/projects/66f0a33f1aeb4c35ba51c2716991f0c8/users/70bf10f23e7846d9b3d9de0440f0d297/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.398014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f0a33f1aeb4c35ba51c2716991f0c8, user_id=70bf10f23e7846d9b3d9de0440f0d297, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.400988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.402022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 986/1961] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:51.407124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.407420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.407843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.416177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 976/1962] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:51 2022] PUT /identity/v3/projects/66f0a33f1aeb4c35ba51c2716991f0c8/users/70bf10f23e7846d9b3d9de0440f0d297/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:51.416177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.450976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] MFA Rules not processed for user `ee5ebf51c98e42888492c5d4bc53cdab`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:51.452532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.489933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c65f7-305c-4504-8d2a-8bec4c220c8b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.494897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.495636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.495924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.496535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.496821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:51.497119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.498823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd09428-bb20-4dd5-9e49-0e56e41b97e3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.515090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 977/1963] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:51.515090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.515090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.515090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.555937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 987/1964] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:51.556997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.566078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] MFA Rules not processed for user `70bf10f23e7846d9b3d9de0440f0d297`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:51.567693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.569909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aaea8-7489-466d-8617-9c46d75d5d07 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.574989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.575647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.576022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.576627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.577069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.579975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.670921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 978/1965] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:51.674333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.678138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:51.680320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.697601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 988/1966] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:51.698574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.701185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:51.709967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43bc2f-a1af-499c-bbcf-5e7186d2f002 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.788866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.789906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.790378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.790793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.791598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.794504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.797588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f163f88-77e6-45ea-94a6-8783d8f66b81 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.801779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.802536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.802988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.803423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.882072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.883613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.897127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 989/1967] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:51.898394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.912078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0df7-cabf-41f3-8b48-e3ecb86890e7 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:51.917674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:51.923736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:51.923736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:51.923736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:51.923736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:51.923736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:51.969277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 979/1968] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/projects => generated 383 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:51.969277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:51.969623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:52.032450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a66d7-075e-4387-b0f4-8f0f84cbb4a2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.036926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.037569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.037844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.038109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] PATH_INFO: `/v3/projects/8bd6f603249e425a9f97f241c1fa0f5f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.039200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd6f603249e425a9f97f241c1fa0f5f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.041119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.159661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 990/1969] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:51 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:52.160464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.169906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1602-c9cd-4228-8a70-93048c83b8ce admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.174771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.175359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.175706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.175895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.176509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.178622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.266746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd6f603249e425a9f97f241c1fa0f5f', 'request_id': 'req-2368ffc8-d99a-4c23-a446-28d4d1924f2a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.391317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd6f603249e425a9f97f241c1fa0f5f', 'request_id': 'req-2368ffc8-d99a-4c23-a446-28d4d1924f2a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.399387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 991/1970] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:52 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:46:52.399387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.403097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd6f603249e425a9f97f241c1fa0f5f', 'request_id': 'req-2368ffc8-d99a-4c23-a446-28d4d1924f2a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.413572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087ce91-7494-46a0-bf90-d6ecbe4787e1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.416761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] The token cache is being invalidate because project 8bd6f603249e425a9f97f241c1fa0f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:52.417053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.417745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.419368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 980/1971] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:51 2022] DELETE /identity/v3/projects/8bd6f603249e425a9f97f241c1fa0f5f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:52.423180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.424738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:52.473884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.474518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.474796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.475066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.475704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.477326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.485063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ffc8-d99a-4c23-a446-28d4d1924f2a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.488370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 992/1972] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:52.489166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.489311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.489966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.490240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.490531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.492568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:52.492705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:52.504665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8631e-7458-490c-bf5e-0bd229c84f35 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.509340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.509951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.510220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.510490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.511133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.512913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.528220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 993/1973] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:52.529079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.533242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:52.545995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4f84-9b0a-453d-bf9b-fc0fa73dfd03 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.551265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.551950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.552226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.552497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] PATH_INFO: `/v3/users/4f3e98a8be834279bad3ba6b51f45fee` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.553717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3e98a8be834279bad3ba6b51f45fee)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.555679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.566702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.567804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.583768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 981/1974] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:52.584353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.585797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:52.606775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e94e-0a97-413a-b262-af5b976afa1e service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.612302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.613010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.613396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.613850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.614574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.617257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.630904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 982/1975] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:52.635258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.646919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba90b3-8d37-4fe0-a844-30885f02c6fe admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.652164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.652948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.653368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.653762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] PATH_INFO: `/v3/projects/d68046e7613e4c22be3e660b13372706/users/dc41e80437ff47e791762f41da28bc43/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.670294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68046e7613e4c22be3e660b13372706, user_id=dc41e80437ff47e791762f41da28bc43, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.673024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.796967 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 983/1976] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:52 2022] PUT /identity/v3/projects/d68046e7613e4c22be3e660b13372706/users/dc41e80437ff47e791762f41da28bc43/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:52.797760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:52.859556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58886fa-7432-42fc-8ad3-d8c64ae84d97 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:52.864065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:52.864715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:52.864987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:52.865282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] PATH_INFO: `/v3/projects/77d62759a4124afc8fc744c51ba7a07a/users/04a9a99e17274f06a6cbdb753be95838/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:52.880445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d62759a4124afc8fc744c51ba7a07a, user_id=04a9a99e17274f06a6cbdb753be95838, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:52.883137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:52.938576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3e98a8be834279bad3ba6b51f45fee'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.939226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3e98a8be834279bad3ba6b51f45fee'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.939838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3e98a8be834279bad3ba6b51f45fee'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:52.946909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3e98a8be834279bad3ba6b51f45fee'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:53.042490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 984/1977] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:52 2022] PUT /identity/v3/projects/77d62759a4124afc8fc744c51ba7a07a/users/04a9a99e17274f06a6cbdb753be95838/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:53.043336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.044877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.072214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bfb9f382-1afa-4276-a36f-86b2004524ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3e98a8be834279bad3ba6b51f45fee'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:53.094942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 994/1978] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:52 2022] DELETE /identity/v3/users/4f3e98a8be834279bad3ba6b51f45fee => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:53.096199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.096491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.096767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.118945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5bf03-bde0-4dcc-b3cb-275efa9f7398 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.129294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] MFA Rules not processed for user `04a9a99e17274f06a6cbdb753be95838`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:53.131068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.185050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.185858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.185975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.186224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.189532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.191724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.204896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 985/1980] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:53.205056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 995/1980] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:53.209306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.214788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.214788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.221364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3596-74f4-4249-a4bf-7a7cb2bd11dd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.223727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57334f-ecd3-4eb1-b028-850e02272fa4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.225988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64b1b6-d8a5-4160-a619-604c5251f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.226671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b1b6-d8a5-4160-a619-604c5251f849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.226944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b1b6-d8a5-4160-a619-604c5251f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.227209 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b1b6-d8a5-4160-a619-604c5251f849 admin admin] PATH_INFO: `/v3/projects/d68046e7613e4c22be3e660b13372706/users/dc41e80437ff47e791762f41da28bc43/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.228337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.228922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.229202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.229314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64b1b6-d8a5-4160-a619-604c5251f849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68046e7613e4c22be3e660b13372706, user_id=dc41e80437ff47e791762f41da28bc43, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.229504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.230123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.231869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64b1b6-d8a5-4160-a619-604c5251f849 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.232020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.243795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 996/1981] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:53 2022] PUT /identity/v3/projects/d68046e7613e4c22be3e660b13372706/users/dc41e80437ff47e791762f41da28bc43/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:53.255631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.255918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.256193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.284911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] MFA Rules not processed for user `dc41e80437ff47e791762f41da28bc43`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:53.286163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.368243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 997/1982] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:53.374797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 986/1983] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:53 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:53.378208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.384885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.386849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.467012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c332-351d-45eb-b4d5-a64fea0c6436 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.470151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1573841-02fd-457c-8dc0-359d6dd7ead5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.472859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.473672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.474046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.474549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.549143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.550689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.552382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.552997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.553315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.553999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.554654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.556580 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.561043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 987/1984] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:46:53.654971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.657502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.673160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cce3e-606f-4e01-be85-80862859d690 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.679723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.680577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.682334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.682767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] PATH_INFO: `/v3/projects/fc5309b344c2491cbe0ba39c0af3431c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.684279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5309b344c2491cbe0ba39c0af3431c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.687813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.691287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 998/1985] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:53 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:53.695583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.710714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f26c3-f326-4e36-bc53-68075c4ad177 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.728424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.730264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.730264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.730264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.730708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.732205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.747573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 999/1986] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:46:53.748525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.752335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.765420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021e79-2d1a-456f-8d91-06912585fe2e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.770824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.770824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.770824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.770824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.772645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:53.842115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.843725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.853563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1000/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:53.854356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:53.865954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5309b344c2491cbe0ba39c0af3431c', 'request_id': 'req-bc17da18-d1c1-4f88-a103-b642c641d070'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:53.883167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf92a4-ed1f-4f51-b2f3-5eaeb843b5ba service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:53.951010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:53.951678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:53.951963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:53.952369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] PATH_INFO: `/v3/projects/d651aaddb79a426587e699c7c64d603f/users/0b3283226ff64afd952507519eeadfcd/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:53.967521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d651aaddb79a426587e699c7c64d603f, user_id=0b3283226ff64afd952507519eeadfcd, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:53.970960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:53.996273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5309b344c2491cbe0ba39c0af3431c', 'request_id': 'req-bc17da18-d1c1-4f88-a103-b642c641d070'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:54.003951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5309b344c2491cbe0ba39c0af3431c', 'request_id': 'req-bc17da18-d1c1-4f88-a103-b642c641d070'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:54.015684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] The token cache is being invalidate because project fc5309b344c2491cbe0ba39c0af3431c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:54.016088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:54.016760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bc17da18-d1c1-4f88-a103-b642c641d070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:54.018326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 988/1988] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:53 2022] DELETE /identity/v3/projects/fc5309b344c2491cbe0ba39c0af3431c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:54.024067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25331-cb9f-4deb-93b6-bfe427400be3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.024377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25331-cb9f-4deb-93b6-bfe427400be3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.024621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25331-cb9f-4deb-93b6-bfe427400be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.048088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f3c25331-cb9f-4deb-93b6-bfe427400be3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:54.049332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f3c25331-cb9f-4deb-93b6-bfe427400be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:54.061278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 989/1989] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:54.066165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.066762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.067199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.089422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:54.090597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:54.098961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1001/1990] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:53 2022] PUT /identity/v3/projects/d651aaddb79a426587e699c7c64d603f/users/0b3283226ff64afd952507519eeadfcd/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:54.102068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.103690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:54.161492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 990/1991] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:54.165804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.176298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0403-ee70-498c-b492-fa2ee60cb2b8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.176960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3d0c1-5196-43e8-9e18-3443f602826c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.181176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.181814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.181968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.182117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.182352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.182503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.182748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.182998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:54.183115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.183292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.183637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.184896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.185236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.198009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1002/1992] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:54.198208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 991/1993] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:46:54.204102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.204501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.214032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ff848-c9ea-4967-a00a-64709f3b67d1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.214458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdec1c-622a-48d0-a5b9-0a3a3ef77653 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.219398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb653c-4250-4bfd-84b6-d3f8ee73683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.219793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.220032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb653c-4250-4bfd-84b6-d3f8ee73683a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.220308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb653c-4250-4bfd-84b6-d3f8ee73683a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.220429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.220566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb653c-4250-4bfd-84b6-d3f8ee73683a admin admin] PATH_INFO: `/v3/projects/d651aaddb79a426587e699c7c64d603f/users/0b3283226ff64afd952507519eeadfcd/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.221675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.221953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.222576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.222898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb653c-4250-4bfd-84b6-d3f8ee73683a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d651aaddb79a426587e699c7c64d603f, user_id=0b3283226ff64afd952507519eeadfcd, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.224502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.226082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb653c-4250-4bfd-84b6-d3f8ee73683a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.238873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1003/1994] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:54 2022] PUT /identity/v3/projects/d651aaddb79a426587e699c7c64d603f/users/0b3283226ff64afd952507519eeadfcd/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:54.248857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.249143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.249448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.277156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] MFA Rules not processed for user `0b3283226ff64afd952507519eeadfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:54.278479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:54.326369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:54.349653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1004/1995] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:54.381850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.383583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:54.430478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 992/1996] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:54 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:54.431482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.449548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07408dbc-9bf0-4b56-9240-7b6eb10a3787 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.500206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d84be-39c1-4966-b25e-b7ff2ec1151f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.504252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.504715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.504862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.505125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.505351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.505460 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.505636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.505969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.506570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.508509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.569719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.571196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.581786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1005/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:54.637412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 993/1998] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:46:54 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:46:54.638550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.649086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a6424-cb47-4dc6-b2e1-b8436002fcf1 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.653671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.654258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.654536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.654803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.655451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.657052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.666729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1006/1999] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:54.670781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.681146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82becef-f0d5-4143-8350-8677f0f36aad admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.685959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb57d2-500f-4958-9cf1-970204972403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.687179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb57d2-500f-4958-9cf1-970204972403 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.687539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb57d2-500f-4958-9cf1-970204972403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.687814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb57d2-500f-4958-9cf1-970204972403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.688543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb57d2-500f-4958-9cf1-970204972403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.690274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb57d2-500f-4958-9cf1-970204972403 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.700554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 994/2000] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:46:54.705065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:54.714890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f193ad-58bf-4dc0-8a01-97ba12efc82d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:54.719757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:54.720394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.720671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.720938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] PATH_INFO: `/v3/projects/aeaa431cd1ed43bc993946d00fe74a6d/users/61476c5817684d6a9d9299c7e81cd4b3/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.735827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaa431cd1ed43bc993946d00fe74a6d, user_id=61476c5817684d6a9d9299c7e81cd4b3, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:54.738665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:54.856506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1007/2001] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:46:54 2022] PUT /identity/v3/projects/aeaa431cd1ed43bc993946d00fe74a6d/users/61476c5817684d6a9d9299c7e81cd4b3/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:54.867390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:54.867678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:54.867953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:54.896022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] MFA Rules not processed for user `61476c5817684d6a9d9299c7e81cd4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:54.897255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:54.970100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 995/2002] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:55.042726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:55.071934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:55.129243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572437-12f9-45fa-be68-46ec393a76be admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:55.137712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150225fc-6019-4481-9253-7aea329cce4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:55.138324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150225fc-6019-4481-9253-7aea329cce4a service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:55.138599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150225fc-6019-4481-9253-7aea329cce4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:55.138867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150225fc-6019-4481-9253-7aea329cce4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:55.147516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150225fc-6019-4481-9253-7aea329cce4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:55.148876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150225fc-6019-4481-9253-7aea329cce4a service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:55.158866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1008/2003] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:55.211247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:55.212683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:55.329075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24acbb-a623-48cc-8faf-9d6184d9c569 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:55.337306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:55.337945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:55.338220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:55.338487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] PATH_INFO: `/v3/users/ee5ebf51c98e42888492c5d4bc53cdab` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:55.339831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5ebf51c98e42888492c5d4bc53cdab)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:55.341976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:55.972602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5ebf51c98e42888492c5d4bc53cdab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:55.973637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5ebf51c98e42888492c5d4bc53cdab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:56.082187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5ebf51c98e42888492c5d4bc53cdab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:56.090543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5ebf51c98e42888492c5d4bc53cdab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:56.091350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5ebf51c98e42888492c5d4bc53cdab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:56.110389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 996/2004] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:55 2022] DELETE /identity/v3/users/ee5ebf51c98e42888492c5d4bc53cdab => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:56.115128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:56.115617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:56.115723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:56.135367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:56.136624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:56.220602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1009/2005] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:46:56.232283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:56.234926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:56.303168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbcf1-6392-44b0-bcaa-027a2819a2d4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:56.306784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:56.307385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:56.307657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:56.307976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:56.320458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:56.322233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:56.349593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 997/2006] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:56.786824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:56.790563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:56.808884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7dc01-2836-4cfa-afcc-a83d481161c4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:56.815627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:56.816383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:56.816674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:56.816852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] PATH_INFO: `/v3/users/04a9a99e17274f06a6cbdb753be95838` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:56.818132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a9a99e17274f06a6cbdb753be95838)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:56.821192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:56.976100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:56.977742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:56.993404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafb36b-0437-432e-882b-d0d08da28e01 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:57.012742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:57.013423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:57.014137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:57.014604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] PATH_INFO: `/v3/projects/dfae00ce13ec439db2637eb398dbae6f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:57.017946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfae00ce13ec439db2637eb398dbae6f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:57.020556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:57.164162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a9a99e17274f06a6cbdb753be95838'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.164838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a9a99e17274f06a6cbdb753be95838'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.165521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a9a99e17274f06a6cbdb753be95838'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.168275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfae00ce13ec439db2637eb398dbae6f', 'request_id': 'req-bb347b4c-955d-4c26-95a4-00cdc20b323f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.174219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a9a99e17274f06a6cbdb753be95838'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.290935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfae00ce13ec439db2637eb398dbae6f', 'request_id': 'req-bb347b4c-955d-4c26-95a4-00cdc20b323f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.297858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfae00ce13ec439db2637eb398dbae6f', 'request_id': 'req-bb347b4c-955d-4c26-95a4-00cdc20b323f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.309044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] The token cache is being invalidate because project dfae00ce13ec439db2637eb398dbae6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:57.309386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.310046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.311559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 998/2007] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:56 2022] DELETE /identity/v3/projects/dfae00ce13ec439db2637eb398dbae6f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:57.315704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:57.317073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:57.391077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0ee96ab-2697-46f8-b7e3-008cb6d8ad72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a9a99e17274f06a6cbdb753be95838'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.392758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347b4c-955d-4c26-95a4-00cdc20b323f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:57.396541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:57.397435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:57.397774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:57.398108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] PATH_INFO: `/v3/users/dc41e80437ff47e791762f41da28bc43` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:57.399335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc41e80437ff47e791762f41da28bc43)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:57.401623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:57.426481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1010/2008] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:56 2022] DELETE /identity/v3/users/04a9a99e17274f06a6cbdb753be95838 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:57.431071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d3fd-53a9-488f-b1cf-e65f907ca26c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:57.432541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d3fd-53a9-488f-b1cf-e65f907ca26c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:57.432826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d3fd-53a9-488f-b1cf-e65f907ca26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:57.507040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5af6d3fd-53a9-488f-b1cf-e65f907ca26c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:57.508293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5af6d3fd-53a9-488f-b1cf-e65f907ca26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:57.646754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1011/2009] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:57.650807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:57.651242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:57.651564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:57.682235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] MFA Rules not processed for user `61476c5817684d6a9d9299c7e81cd4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:57.683467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:57.692705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc41e80437ff47e791762f41da28bc43'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.693418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc41e80437ff47e791762f41da28bc43'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.754107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1012/2010] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:57.754107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:57.754814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:57.773436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc41e80437ff47e791762f41da28bc43'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.785244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc41e80437ff47e791762f41da28bc43'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.786612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc41e80437ff47e791762f41da28bc43'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:57.822766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cf765-5f22-4ed2-ae62-6ed8bbbd4069 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:57.823896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 999/2011] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:57 2022] DELETE /identity/v3/users/dc41e80437ff47e791762f41da28bc43 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:57.874938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:57.918124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:57.918858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:57.919143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:57.919412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:57.922468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:58.000772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:58.002732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:58.015064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1013/2012] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:46:58.625712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:58.690803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:58.693755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:58.715475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24926dba-cbdc-46fe-97a4-b386e634587f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:58.731143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:58.731812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:58.732271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:58.732694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] PATH_INFO: `/v3/projects/77d62759a4124afc8fc744c51ba7a07a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:58.734809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d62759a4124afc8fc744c51ba7a07a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:58.737150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:58.864728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d62759a4124afc8fc744c51ba7a07a', 'request_id': 'req-b648c33f-0cef-4054-96af-e63d2477a5e7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:58.971147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d62759a4124afc8fc744c51ba7a07a', 'request_id': 'req-b648c33f-0cef-4054-96af-e63d2477a5e7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:58.990723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d62759a4124afc8fc744c51ba7a07a', 'request_id': 'req-b648c33f-0cef-4054-96af-e63d2477a5e7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.005831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] The token cache is being invalidate because project 77d62759a4124afc8fc744c51ba7a07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:59.006459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.007368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.009818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1000/2013] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:58 2022] DELETE /identity/v3/projects/77d62759a4124afc8fc744c51ba7a07a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:59.013606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:59.027151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce773d-9af1-43d8-97f3-9ade1a18c760 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:59.104593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:59.105295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:59.105578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:59.105852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] PATH_INFO: `/v3/users/0b3283226ff64afd952507519eeadfcd` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:59.107015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3283226ff64afd952507519eeadfcd)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:59.109745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:59.271874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:59.273319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:59.287942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c33f-0cef-4054-96af-e63d2477a5e7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:59.292685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:59.293352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:59.293645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:59.293895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] PATH_INFO: `/v3/projects/d68046e7613e4c22be3e660b13372706` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:59.295147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68046e7613e4c22be3e660b13372706)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:59.297911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:59.515493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68046e7613e4c22be3e660b13372706', 'request_id': 'req-201074b3-4485-4930-b4d2-0ea51b3ae5d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.520804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3283226ff64afd952507519eeadfcd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.524527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3283226ff64afd952507519eeadfcd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.525825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3283226ff64afd952507519eeadfcd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.540488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3283226ff64afd952507519eeadfcd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.621766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68046e7613e4c22be3e660b13372706', 'request_id': 'req-201074b3-4485-4930-b4d2-0ea51b3ae5d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.632239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68046e7613e4c22be3e660b13372706', 'request_id': 'req-201074b3-4485-4930-b4d2-0ea51b3ae5d6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.658070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] The token cache is being invalidate because project d68046e7613e4c22be3e660b13372706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:46:59.658607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.659428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-201074b3-4485-4930-b4d2-0ea51b3ae5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.661560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1001/2014] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:46:59 2022] DELETE /identity/v3/projects/d68046e7613e4c22be3e660b13372706 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:46:59.666413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1345-47de-4e78-aba4-afb7dcc4760b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:59.666881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1345-47de-4e78-aba4-afb7dcc4760b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:59.667337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1345-47de-4e78-aba4-afb7dcc4760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:59.689585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a42c1345-47de-4e78-aba4-afb7dcc4760b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:59.690921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a42c1345-47de-4e78-aba4-afb7dcc4760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:59.734295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3283226ff64afd952507519eeadfcd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:46:59.754443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1002/2015] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:59.754784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1014/2016] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:46:59 2022] DELETE /identity/v3/users/0b3283226ff64afd952507519eeadfcd => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:46:59.762688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133350-45da-46fc-8917-af269a059abe None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:59.763176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133350-45da-46fc-8917-af269a059abe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:59.763450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133350-45da-46fc-8917-af269a059abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:59.789962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-83133350-45da-46fc-8917-af269a059abe None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:46:59.791476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-83133350-45da-46fc-8917-af269a059abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:59.899451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1003/2017] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:46:59.900990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:59.902510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:46:59.918956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120ff55-0995-4730-9c03-59b21c910252 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:59.925861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:59.926744 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:59.927852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:59.928132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:59.928841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:46:59.929361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:59.932085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:46:59.946169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1015/2018] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:46:59.948516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:46:59.951149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133350-45da-46fc-8917-af269a059abe None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:46:59.966371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133350-45da-46fc-8917-af269a059abe None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:46:59.972820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:46:59.973379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:46:59.973840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:46:59.974265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:46:59.975297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:46:59.977406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.141874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1004/2019] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:46:59 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:00.146058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.161493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e929e4-24e9-4eb1-b1c5-eab302394f6d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.275046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.276029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.276309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.276569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.277206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.279304 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.396601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:00.402691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1016/2020] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:00 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:00.406953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.417279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82034e-8e13-4620-b9c7-1457a77bde85 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.422089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.422679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.422955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.423224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.423866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.425524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.439096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1005/2021] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:00.440429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.450665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d175b-4e7c-4afc-942a-5423fd995f58 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.457169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.459638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.459978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.460196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.461351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.467203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.485336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1017/2022] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:00.489695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.500966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664d6d-e814-4e26-8452-9c6c60eb780e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.505577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f243f2-e496-432b-a26c-74c2d7c87331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.506222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f243f2-e496-432b-a26c-74c2d7c87331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.506527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f243f2-e496-432b-a26c-74c2d7c87331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.506799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f243f2-e496-432b-a26c-74c2d7c87331 admin admin] PATH_INFO: `/v3/projects/ca3e4ac03bc244f79379810eac7f40a4/users/7bfee0bbb6b0433ab45f2741bb4d6cb2/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.525174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.526426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f243f2-e496-432b-a26c-74c2d7c87331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3e4ac03bc244f79379810eac7f40a4, user_id=7bfee0bbb6b0433ab45f2741bb4d6cb2, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.527687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:00.529533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f243f2-e496-432b-a26c-74c2d7c87331 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.544840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987024fc-e8e6-417a-8114-0e35067476b0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.550976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.551781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.552066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.552440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] PATH_INFO: `/v3/projects/d651aaddb79a426587e699c7c64d603f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.553746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d651aaddb79a426587e699c7c64d603f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.555879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.637636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1006/2023] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:00 2022] PUT /identity/v3/projects/ca3e4ac03bc244f79379810eac7f40a4/users/7bfee0bbb6b0433ab45f2741bb4d6cb2/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:00.649993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.650407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.650728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.684204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] MFA Rules not processed for user `7bfee0bbb6b0433ab45f2741bb4d6cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:00.685706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:00.706015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd651aaddb79a426587e699c7c64d603f', 'request_id': 'req-22b33226-3638-473b-85f8-9fe824ad0d60'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:00.714233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd651aaddb79a426587e699c7c64d603f', 'request_id': 'req-22b33226-3638-473b-85f8-9fe824ad0d60'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:00.760757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1007/2024] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:00.772984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.774591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:00.821949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd651aaddb79a426587e699c7c64d603f', 'request_id': 'req-22b33226-3638-473b-85f8-9fe824ad0d60'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:00.835620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d7c16-b83a-4389-971d-b6c723ef3570 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.837181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] The token cache is being invalidate because project d651aaddb79a426587e699c7c64d603f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:00.837511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:00.838175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:00.839707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1018/2025] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:00 2022] DELETE /identity/v3/projects/d651aaddb79a426587e699c7c64d603f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:00.840728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:00.842988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.843419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:00.843748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.844425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.844743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.846662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:00.863222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.864070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0ee5-979a-4c7b-968c-db35f2dd2fa1 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.873586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1008/2026] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:00.875572 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5823-5455-4da8-a35a-1ac4ef370e2d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.875998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5823-5455-4da8-a35a-1ac4ef370e2d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.876414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5823-5455-4da8-a35a-1ac4ef370e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.899012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a7e5823-5455-4da8-a35a-1ac4ef370e2d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:00.900245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a7e5823-5455-4da8-a35a-1ac4ef370e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:00.913754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33226-3638-473b-85f8-9fe824ad0d60 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:00.924278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:00.925668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.926029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.926532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] PATH_INFO: `/v3/users/da74c6076b204ddeab14f9f2c171264a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:00.928526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da74c6076b204ddeab14f9f2c171264a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:00.930699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:00.977382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1009/2027] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:00.986170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:00.987048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:00.987048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.005986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:01.007172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:01.016361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1010/2028] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:01.020912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.030902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52cd6-7698-45fd-8afb-34c9652aa8c7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.044684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.044684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.044684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.044684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.045114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:01.045402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.048361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.061264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1011/2029] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:47:01.066212 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.076864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73101c0c-78e7-42b0-b4a6-dda02a613789 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.082006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.082801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.083096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.083465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.084342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.086207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.211297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1012/2030] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:01 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:01.214899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da74c6076b204ddeab14f9f2c171264a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.215367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.215656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da74c6076b204ddeab14f9f2c171264a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.216307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da74c6076b204ddeab14f9f2c171264a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.216857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:01.224361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da74c6076b204ddeab14f9f2c171264a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.287759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf420f-8d94-4c90-979d-df563ff28950 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.292901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.298552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.298552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.298552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.298552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.298552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.347008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da74c6076b204ddeab14f9f2c171264a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.372712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1019/2031] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:00 2022] DELETE /identity/v3/users/da74c6076b204ddeab14f9f2c171264a => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:01.433791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1013/2032] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:01 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:01.437612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.527257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501a29-1d0e-4047-82d2-a60f46ed368a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.534740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.535835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.536202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.536369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.537065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.539099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.561120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1020/2033] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:01.562493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.574778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2f68e-3aa0-4495-88d7-1bba66796194 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.580556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.581495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.581772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.582036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.583528 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.585140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.600275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1014/2034] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:01.601671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.618593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67ecd1-09a3-4334-8feb-123dd43b4944 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.630177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2f10d-e9bd-49b4-a051-87b7d31c5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.630177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2f10d-e9bd-49b4-a051-87b7d31c5f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.630177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2f10d-e9bd-49b4-a051-87b7d31c5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.630177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2f10d-e9bd-49b4-a051-87b7d31c5f6d admin admin] PATH_INFO: `/v3/projects/1e6f492946c546b2b2aafa33ce31602d/users/9f76a61c9e0945e0a072135b4e2e0e6a/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.641403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2f10d-e9bd-49b4-a051-87b7d31c5f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6f492946c546b2b2aafa33ce31602d, user_id=9f76a61c9e0945e0a072135b4e2e0e6a, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.644038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2f10d-e9bd-49b4-a051-87b7d31c5f6d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.656169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.658096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:01.671916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8604d-4ddb-466d-a14a-3ee6245c4605 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.678929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:01.679394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.679692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.679956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] PATH_INFO: `/v3/projects/4a17c4018eb644b3b766e698e66bf1bd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.681068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a17c4018eb644b3b766e698e66bf1bd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:01.683109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:01.762329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1021/2035] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:01 2022] PUT /identity/v3/projects/1e6f492946c546b2b2aafa33ce31602d/users/9f76a61c9e0945e0a072135b4e2e0e6a/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:01.776535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.776822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.777091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:01.807171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] MFA Rules not processed for user `9f76a61c9e0945e0a072135b4e2e0e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:01.808401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:01.842834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a17c4018eb644b3b766e698e66bf1bd', 'request_id': 'req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.872614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1022/2036] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:01.884459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:01.885807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:01.942502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6acf-7013-42b8-a6c8-2215ddcee2f0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:01.956017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a17c4018eb644b3b766e698e66bf1bd', 'request_id': 'req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.963107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a17c4018eb644b3b766e698e66bf1bd', 'request_id': 'req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.975570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] The token cache is being invalidate because project 4a17c4018eb644b3b766e698e66bf1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:01.975854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.976637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5e30c7c6-9bba-4f37-a454-f39ba8c8a8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:01.978389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1015/2037] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:01 2022] DELETE /identity/v3/projects/4a17c4018eb644b3b766e698e66bf1bd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:01.982818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92311-2b17-4ce5-b2cf-1faa08de439b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:01.983334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92311-2b17-4ce5-b2cf-1faa08de439b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:01.984205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92311-2b17-4ce5-b2cf-1faa08de439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.006036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.006036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.006036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.006036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.006499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:02.006585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3ec92311-2b17-4ce5-b2cf-1faa08de439b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:02.006698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3ec92311-2b17-4ce5-b2cf-1faa08de439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:02.068375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.070780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1016/2038] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:02.070995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.080991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1023/2039] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:02.083556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.083843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.084116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.098369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:02.119696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:02.121121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:02.129836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1017/2040] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:02.134505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:02.146104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d040-3bba-42d1-94c6-cceb3a36aaa6 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:02.150932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.151588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.151863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.152284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.152911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:02.153199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.154849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.168252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1024/2041] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:02.173408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:02.183487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ed79-25e0-4fce-8aa3-1de454e26000 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:02.188866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.189719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.190000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.190351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.191150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.193065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.344373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1018/2042] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:02 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:02.348598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:02.361627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e5e98-f754-464b-bfe4-c8cc1ab4678e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:02.426667 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:02.432875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.433804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.433804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.434055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.434664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.437253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.565253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1025/2043] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:02 2022] POST /identity/v3/users => generated 303 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:02.566345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:02.576459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e1bc1-e2b9-4a7e-b93b-c8804bfc5ad2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:02.581441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.582074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.582347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.582608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.583261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.584854 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.598957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1019/2044] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:02.600178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:02.613841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870cf54-d0d8-4e07-a1d6-faa1f6c32b35 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:02.625355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb1a79-3467-4257-8ed3-fdfa93e69026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.625355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1a79-3467-4257-8ed3-fdfa93e69026 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.625355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1a79-3467-4257-8ed3-fdfa93e69026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.625355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1a79-3467-4257-8ed3-fdfa93e69026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.625804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb1a79-3467-4257-8ed3-fdfa93e69026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.627051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb1a79-3467-4257-8ed3-fdfa93e69026 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.642672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1026/2045] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:02.643810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:02.654621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f747c7-3c1a-48c9-afe6-66ff00780b01 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:02.661687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:02.662346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.662622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.662893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] PATH_INFO: `/v3/projects/a46603812a234a02ae0abf640eb385eb/users/1db607a8679445119c7f3a82c6016e81/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.678657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46603812a234a02ae0abf640eb385eb, user_id=1db607a8679445119c7f3a82c6016e81, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:02.681359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:02.835158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1020/2046] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:02 2022] PUT /identity/v3/projects/a46603812a234a02ae0abf640eb385eb/users/1db607a8679445119c7f3a82c6016e81/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:02.845389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:02.845677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:02.845949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:02.876740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] MFA Rules not processed for user `1db607a8679445119c7f3a82c6016e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:02.878064 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:02.944537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1027/2047] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:02.948896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.056183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf446-7bc0-49ff-9518-7c6fb5e125f5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.061494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.062143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.062551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.062826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.063467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:03.065449 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:03.219959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1021/2048] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:02 2022] POST /identity/v3/projects => generated 405 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:03.221990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.232699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42e14-85fc-46e2-a45c-3bc1891907b5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.298528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.299139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.299413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.300273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.300989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:03.303015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:03.436743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1028/2049] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:03 2022] POST /identity/v3/users => generated 309 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:03.438232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.449243 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9bf1-bbe9-48c2-b26b-940fb2700e33 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.455934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.456428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.456725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.457048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.457825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:03.459544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:03.471405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1022/2050] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:03.475779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.486527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64c620-f4bc-4e0b-b5f3-4800c0c0d426 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.491092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.491739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.492015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.492286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] PATH_INFO: `/v3/projects/ab583b7f84704c51b35ce8ef98e22b2f/users/ec512db2d6c4418eb7b97c1c14948abb/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.506629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab583b7f84704c51b35ce8ef98e22b2f, user_id=ec512db2d6c4418eb7b97c1c14948abb, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:03.509354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:03.591018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1029/2051] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:03 2022] PUT /identity/v3/projects/ab583b7f84704c51b35ce8ef98e22b2f/users/ec512db2d6c4418eb7b97c1c14948abb/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:03.596361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.607378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ceae-a859-4bd1-bf42-dbf1c9b2698d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.687447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d317f-27b7-47c6-b44e-516d943c27d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.688266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d317f-27b7-47c6-b44e-516d943c27d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.692051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d317f-27b7-47c6-b44e-516d943c27d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.692051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:03.692051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d317f-27b7-47c6-b44e-516d943c27d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.692051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d317f-27b7-47c6-b44e-516d943c27d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:03.693011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d317f-27b7-47c6-b44e-516d943c27d3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:03.703814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1023/2052] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:03.708040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.719545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90b486-ab7e-42e1-8b98-f06428e6f6bb admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.724493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.725181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.725494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.732333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] PATH_INFO: `/v3/projects/ab583b7f84704c51b35ce8ef98e22b2f/users/ec512db2d6c4418eb7b97c1c14948abb/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.732333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab583b7f84704c51b35ce8ef98e22b2f, user_id=ec512db2d6c4418eb7b97c1c14948abb, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:03.732333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:03.742788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1030/2053] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:03 2022] PUT /identity/v3/projects/ab583b7f84704c51b35ce8ef98e22b2f/users/ec512db2d6c4418eb7b97c1c14948abb/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:03.755576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.755871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.756150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.788867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] MFA Rules not processed for user `ec512db2d6c4418eb7b97c1c14948abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:03.790739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:03.868534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1024/2054] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:03.883078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:03.884785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:03.962838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:03.981076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710ec2e-9bd7-49d0-ba6a-0d8cff84d3e5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:03.986623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff3eea-5cdb-44ec-86c3-17a72c0af0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:03.987550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3eea-5cdb-44ec-86c3-17a72c0af0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:03.987931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3eea-5cdb-44ec-86c3-17a72c0af0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:03.988343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3eea-5cdb-44ec-86c3-17a72c0af0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:03.999255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff3eea-5cdb-44ec-86c3-17a72c0af0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:04.001025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff3eea-5cdb-44ec-86c3-17a72c0af0d3 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:04.012156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1031/2055] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:03 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:04.310326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:04.417716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0381cb2-ac35-41ce-acbb-2bcea281b69b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:04.428663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:04.429457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:04.429741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:04.430013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] PATH_INFO: `/v3/users/1db607a8679445119c7f3a82c6016e81` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:04.433974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db607a8679445119c7f3a82c6016e81)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:04.436307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:04.691101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db607a8679445119c7f3a82c6016e81'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:04.691792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db607a8679445119c7f3a82c6016e81'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:04.770055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db607a8679445119c7f3a82c6016e81'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:04.777813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db607a8679445119c7f3a82c6016e81'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:04.778503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db607a8679445119c7f3a82c6016e81'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:04.801251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1025/2056] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:04 2022] DELETE /identity/v3/users/1db607a8679445119c7f3a82c6016e81 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:04.803355 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:04.803889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:04.803889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:04.824281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:04.825549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:04.886855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1032/2057] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:04.897233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:04.898607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:04.959710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54712d47-12d3-416f-852b-6ee3d1df9545 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:04.963287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:04.963878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:04.964149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:04.964412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:04.973676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:04.975209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:04.985483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1026/2058] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:05.367892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:05.529472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:05.531066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:05.543044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97627a8-1e72-4305-8d39-846c8ee6a0ea None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:05.547876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:05.548600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:05.548880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:05.549150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] PATH_INFO: `/v3/users/7fd0d798f02f4385807f4f6ce2c05dd9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:05.550333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd0d798f02f4385807f4f6ce2c05dd9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:05.552247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:05.642927 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:05.645107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:05.666490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05839ef-e751-441e-b993-d6b8fa161c83 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:05.672426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:05.674101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:05.674631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:05.675688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] PATH_INFO: `/v3/projects/a46603812a234a02ae0abf640eb385eb` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:05.677067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46603812a234a02ae0abf640eb385eb)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:05.679745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:05.845654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd0d798f02f4385807f4f6ce2c05dd9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.846320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd0d798f02f4385807f4f6ce2c05dd9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.846917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd0d798f02f4385807f4f6ce2c05dd9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.851773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46603812a234a02ae0abf640eb385eb', 'request_id': 'req-71bbb5a9-7a95-48b6-bebe-90115dae9397'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.854416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd0d798f02f4385807f4f6ce2c05dd9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.896776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:05.938706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46603812a234a02ae0abf640eb385eb', 'request_id': 'req-71bbb5a9-7a95-48b6-bebe-90115dae9397'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.944813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46603812a234a02ae0abf640eb385eb', 'request_id': 'req-71bbb5a9-7a95-48b6-bebe-90115dae9397'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.956556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] The token cache is being invalidate because project a46603812a234a02ae0abf640eb385eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:05.956840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.957506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:05.959361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1027/2059] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:05 2022] DELETE /identity/v3/projects/a46603812a234a02ae0abf640eb385eb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:05.959910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:05.961155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:06.022681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb5a9-7a95-48b6-bebe-90115dae9397 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:06.027278 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:06.027882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:06.028157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:06.028476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] PATH_INFO: `/v3/users/9f76a61c9e0945e0a072135b4e2e0e6a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:06.029582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f76a61c9e0945e0a072135b4e2e0e6a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:06.031631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:06.053195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd0d798f02f4385807f4f6ce2c05dd9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.071972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1033/2060] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:05 2022] DELETE /identity/v3/users/7fd0d798f02f4385807f4f6ce2c05dd9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:06.072772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:06.074107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:06.146634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29221f-6095-4311-aa2f-583aecc6f585 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:06.152792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:06.153601 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:06.153717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:06.153938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] PATH_INFO: `/v3/users/ec512db2d6c4418eb7b97c1c14948abb` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:06.155234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec512db2d6c4418eb7b97c1c14948abb)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:06.157243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:06.257975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f76a61c9e0945e0a072135b4e2e0e6a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.258658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f76a61c9e0945e0a072135b4e2e0e6a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.341789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f76a61c9e0945e0a072135b4e2e0e6a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.351111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f76a61c9e0945e0a072135b4e2e0e6a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.351920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bf58c75f-f71e-41f9-811e-a968cdd032ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f76a61c9e0945e0a072135b4e2e0e6a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.373818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1028/2061] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:05 2022] DELETE /identity/v3/users/9f76a61c9e0945e0a072135b4e2e0e6a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:06.375029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b09b5-34ad-41f2-8da5-d4f80185137b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:06.375389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b09b5-34ad-41f2-8da5-d4f80185137b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:06.375629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b09b5-34ad-41f2-8da5-d4f80185137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:06.386050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec512db2d6c4418eb7b97c1c14948abb'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.386710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec512db2d6c4418eb7b97c1c14948abb'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.387316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec512db2d6c4418eb7b97c1c14948abb'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.396006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4d4b09b5-34ad-41f2-8da5-d4f80185137b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:06.396445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec512db2d6c4418eb7b97c1c14948abb'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.397296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4d4b09b5-34ad-41f2-8da5-d4f80185137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:06.473002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1029/2062] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:06.474499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:06.474796 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:06.475066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:06.506931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:06.508115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:06.515969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1030/2063] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:06.516774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:06.517937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:06.567367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec512db2d6c4418eb7b97c1c14948abb'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:06.582926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9c463-d7ca-4abb-949e-2028e586f6b7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:06.586716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:06.587039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1034/2064] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:06 2022] DELETE /identity/v3/users/ec512db2d6c4418eb7b97c1c14948abb => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:06.587312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:06.587583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:06.587849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:06.587953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:06.598074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:06.599508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:06.609706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1031/2065] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:06.647631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf43bc-4f6c-4025-adf2-525ed57745aa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:06.651538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:06.652297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:06.652572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:06.653027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:06.716237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:06.717752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:06.727615 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1035/2066] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:07.088450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:07.318793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:07.318793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:07.329352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:07.329352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:07.340950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da837-7b75-4598-afa3-45e03bce0621 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:07.362189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d5386-1558-4f03-b433-88cbcd7afa06 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:07.367959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:07.368590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:07.369000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:07.369297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] PATH_INFO: `/v3/projects/533972065a0245bca8a536895a129bac` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:07.372275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533972065a0245bca8a536895a129bac)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:07.376958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:07.378275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:07.379777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:07.383944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:07.384618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] PATH_INFO: `/v3/projects/ab583b7f84704c51b35ce8ef98e22b2f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:07.386951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab583b7f84704c51b35ce8ef98e22b2f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:07.391438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:07.577198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533972065a0245bca8a536895a129bac', 'request_id': 'req-d5bdf288-6162-4157-9279-4ea4e6e943a2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.588405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab583b7f84704c51b35ce8ef98e22b2f', 'request_id': 'req-9db08b5b-df7c-455e-aa3f-8b4adec188e0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.595065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab583b7f84704c51b35ce8ef98e22b2f', 'request_id': 'req-9db08b5b-df7c-455e-aa3f-8b4adec188e0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.710388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533972065a0245bca8a536895a129bac', 'request_id': 'req-d5bdf288-6162-4157-9279-4ea4e6e943a2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.716664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533972065a0245bca8a536895a129bac', 'request_id': 'req-d5bdf288-6162-4157-9279-4ea4e6e943a2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.729090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] The token cache is being invalidate because project 533972065a0245bca8a536895a129bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:07.729439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.730127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.731614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1032/2067] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:07 2022] DELETE /identity/v3/projects/533972065a0245bca8a536895a129bac => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:07.732383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:07.734388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:07.793629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab583b7f84704c51b35ce8ef98e22b2f', 'request_id': 'req-9db08b5b-df7c-455e-aa3f-8b4adec188e0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.808322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] The token cache is being invalidate because project ab583b7f84704c51b35ce8ef98e22b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:07.808609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.809494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:07.815296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1036/2068] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:07 2022] DELETE /identity/v3/projects/ab583b7f84704c51b35ce8ef98e22b2f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:07.816638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:07.818231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:07.821361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf288-6162-4157-9279-4ea4e6e943a2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:07.886073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:07.886876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:07.887721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:07.887721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] PATH_INFO: `/v3/projects/1e6f492946c546b2b2aafa33ce31602d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:07.889039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6f492946c546b2b2aafa33ce31602d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:07.891075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:07.903535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08b5b-df7c-455e-aa3f-8b4adec188e0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:07.909325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:07.910072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:07.910414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:07.910743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] PATH_INFO: `/v3/users/70bf10f23e7846d9b3d9de0440f0d297` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:07.912530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bf10f23e7846d9b3d9de0440f0d297)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:07.914376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.026481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6f492946c546b2b2aafa33ce31602d', 'request_id': 'req-2079b444-37cb-4452-b329-7628a5cb9b73'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.104674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6f492946c546b2b2aafa33ce31602d', 'request_id': 'req-2079b444-37cb-4452-b329-7628a5cb9b73'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.111586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6f492946c546b2b2aafa33ce31602d', 'request_id': 'req-2079b444-37cb-4452-b329-7628a5cb9b73'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.124784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] The token cache is being invalidate because project 1e6f492946c546b2b2aafa33ce31602d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:08.125267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.126387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2079b444-37cb-4452-b329-7628a5cb9b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.128223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1033/2069] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:07 2022] DELETE /identity/v3/projects/1e6f492946c546b2b2aafa33ce31602d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:08.129599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd60f9-3d4f-4a39-b231-5331d337a2b0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.129888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd60f9-3d4f-4a39-b231-5331d337a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.130608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd60f9-3d4f-4a39-b231-5331d337a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.152991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1fdd60f9-3d4f-4a39-b231-5331d337a2b0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:08.154429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1fdd60f9-3d4f-4a39-b231-5331d337a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:08.215718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1034/2070] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:08.217032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c323b5-e268-47ca-a17c-56546af9cbed None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.217400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c323b5-e268-47ca-a17c-56546af9cbed None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.217814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c323b5-e268-47ca-a17c-56546af9cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.231278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bf10f23e7846d9b3d9de0440f0d297'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.231932 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bf10f23e7846d9b3d9de0440f0d297'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.232624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bf10f23e7846d9b3d9de0440f0d297'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.238792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e4c323b5-e268-47ca-a17c-56546af9cbed None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:08.240030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4c323b5-e268-47ca-a17c-56546af9cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:08.240613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bf10f23e7846d9b3d9de0440f0d297'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.248382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1035/2071] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:08.250384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22845b20-e572-47fc-b23c-d7f1aa465fe6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.250655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22845b20-e572-47fc-b23c-d7f1aa465fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.250930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22845b20-e572-47fc-b23c-d7f1aa465fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.271071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-22845b20-e572-47fc-b23c-d7f1aa465fe6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:08.272266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-22845b20-e572-47fc-b23c-d7f1aa465fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:08.280013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1036/2072] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:08.281153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.281460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.281728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.300662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:08.301840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:08.309443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1037/2073] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:08.310184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.319730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3631f2-2ef3-4bfb-a094-97bfc0c0cba3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.324195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.324749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.325021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.325320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.325946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:08.326240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.327856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.336161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bf10f23e7846d9b3d9de0440f0d297'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:08.339206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1038/2074] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:08.339812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.349508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fd10c-e75d-4e40-b8d6-603f056619e7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.354062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.354639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.354911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.355201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.355821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:08.355986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1037/2075] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:07 2022] DELETE /identity/v3/users/70bf10f23e7846d9b3d9de0440f0d297 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:08.356144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.356916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.358348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.370886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1039/2076] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:08.376031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.386371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471ce3-b658-48ec-b010-8bc1feb2efcd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.425810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f45af7-1c91-4331-a60c-44df157e5c40 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.430737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.431362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.431637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.431905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.432541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.436728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.452277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.452955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.454964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.454964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.454964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.457551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.569559 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1038/2077] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/projects => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:08.570577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.619269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1040/2078] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/projects => generated 369 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:08.629491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.649604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:08.673081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6095b89-68ce-4af5-92e3-3d5a0e05a228 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.716636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0a6d-f514-497e-90b0-502f7d8d2386 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.723338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.724647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.724995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.725360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.726138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.728287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.748178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.748981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.749284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.749555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.750191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.752227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.855647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1041/2079] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:08.858385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.868342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db293-9ddc-4371-852c-2771ed8f1f91 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.872901 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.873731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.874253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.874545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.875188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.876668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:08.876784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.894092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1042/2080] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:08.895220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.895343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1039/2081] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:08 2022] POST /identity/v3/users => generated 278 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:08.896924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:08.897187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.911175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31b53-0c66-4fc8-8d36-71fc7b27e160 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.916312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.917039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.917369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.917623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] PATH_INFO: `/v3/projects/66f0a33f1aeb4c35ba51c2716991f0c8` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.918752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f0a33f1aeb4c35ba51c2716991f0c8)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.921143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.926593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2397f41-514d-4225-8945-60cd2c6824c1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.932737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.933709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.934072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.934549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.935821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.938165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.955843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1040/2082] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:08.957474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:08.970295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa459d68-280a-425b-9f71-fd3665819059 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:08.976140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:08.976819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:08.977177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:08.977504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:08.978138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:08.979983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:08.990161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1041/2083] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:08.990931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.000379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4a55-38c1-42ae-bbf6-15ac098b53f3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.004897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.005750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.006031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.006297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] PATH_INFO: `/v3/projects/8734ca5b67a142808b91b1f250822b64/users/54c8f2d0ee9c449bac92a2b9c66bc0d1/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.021425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8734ca5b67a142808b91b1f250822b64, user_id=54c8f2d0ee9c449bac92a2b9c66bc0d1, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.024322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.114518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1042/2084] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:08 2022] PUT /identity/v3/projects/8734ca5b67a142808b91b1f250822b64/users/54c8f2d0ee9c449bac92a2b9c66bc0d1/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:09.115259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.128661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f0a33f1aeb4c35ba51c2716991f0c8', 'request_id': 'req-e5353e49-5afc-497b-8869-a00c8d464637'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:09.191387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a3a27-6033-427d-b49c-2a4667ccc818 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.269960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f0a33f1aeb4c35ba51c2716991f0c8', 'request_id': 'req-e5353e49-5afc-497b-8869-a00c8d464637'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:09.271245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199305e-8b41-4eeb-955f-3e446df59f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.272352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199305e-8b41-4eeb-955f-3e446df59f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.272668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199305e-8b41-4eeb-955f-3e446df59f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.272975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199305e-8b41-4eeb-955f-3e446df59f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.273657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199305e-8b41-4eeb-955f-3e446df59f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.275325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199305e-8b41-4eeb-955f-3e446df59f37 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.277350 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f0a33f1aeb4c35ba51c2716991f0c8', 'request_id': 'req-e5353e49-5afc-497b-8869-a00c8d464637'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:09.289860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1043/2085] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:09.289860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc915-9f74-4f02-8f3d-84c2dfb0d581 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.289860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc915-9f74-4f02-8f3d-84c2dfb0d581 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.289860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc915-9f74-4f02-8f3d-84c2dfb0d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.293466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] The token cache is being invalidate because project 66f0a33f1aeb4c35ba51c2716991f0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:09.293721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:09.294395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:09.296753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1043/2086] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:08 2022] DELETE /identity/v3/projects/66f0a33f1aeb4c35ba51c2716991f0c8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:09.297590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.299711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:09.313338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353e49-5afc-497b-8869-a00c8d464637 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.318792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283ad8-9aa2-427e-9e11-f54aa9a01949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.319092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283ad8-9aa2-427e-9e11-f54aa9a01949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.319445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283ad8-9aa2-427e-9e11-f54aa9a01949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.319820 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283ad8-9aa2-427e-9e11-f54aa9a01949 admin admin] PATH_INFO: `/v3/projects/ee737894c70845edaea4289c88b254ff/users/e2c7d036eabf4c57876680aa9172ce0e/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.321205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-eebcc915-9f74-4f02-8f3d-84c2dfb0d581 None None] MFA Rules not processed for user `54c8f2d0ee9c449bac92a2b9c66bc0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:09.322522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eebcc915-9f74-4f02-8f3d-84c2dfb0d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:09.348650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283ad8-9aa2-427e-9e11-f54aa9a01949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee737894c70845edaea4289c88b254ff, user_id=e2c7d036eabf4c57876680aa9172ce0e, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.352995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283ad8-9aa2-427e-9e11-f54aa9a01949 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.420891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1044/2087] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:09.420891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.420891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.420891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.446213 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:09.447485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:09.456312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1045/2088] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:09.457290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.458638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:09.493369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1044/2089] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:09 2022] PUT /identity/v3/projects/ee737894c70845edaea4289c88b254ff/users/e2c7d036eabf4c57876680aa9172ce0e/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:09.495064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1837fc-4545-4465-b76b-546f0fb02cd2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.495559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1837fc-4545-4465-b76b-546f0fb02cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.495907 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1837fc-4545-4465-b76b-546f0fb02cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.518676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3e1837fc-4545-4465-b76b-546f0fb02cd2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:09.520175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3e1837fc-4545-4465-b76b-546f0fb02cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:09.562361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ea8aa-50a8-4016-8fd1-40dc75df8e73 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.618942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1045/2090] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:09.618942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.618942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.618942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.628075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.628705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.628983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.629287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.647056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] MFA Rules not processed for user `e2c7d036eabf4c57876680aa9172ce0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:09.648397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:09.695119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.696568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.706228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1046/2091] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:09.707195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.716698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1046/2092] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:09.718336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b5a61-d916-4d38-8cf8-4674587c2717 service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.721549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.723031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.723629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.724049 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.724327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.724972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:09.725310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.726939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.732458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472b3a7-52ba-47db-9b30-643347f32c81 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.739862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.741001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.741727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.741727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.742414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.744491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.762938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1047/2093] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:09.767712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.780757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c39d-76dd-4343-af7d-47f9af5ca110 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:09.785727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:09.786445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:09.786724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:09.786986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:09.787733 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:09.790108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:09.879114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:09.885454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1047/2094] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/projects => generated 357 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:09.888855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.953583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1048/2095] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:09.955266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:09.974708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ce2e-edb3-4163-a18f-a6b133503955 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.063182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a9576-1976-4f30-8d6a-6ce2564f17e2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.067856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.068371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.068762 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.069028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.069274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.069388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.069596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.069808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.070342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.070837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.072721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.073898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.197008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1049/2096] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/users => generated 282 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:10.198078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.201497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:10.214703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378ea8a-1438-4c49-9ff7-187518154fa0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.223124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.223761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.224113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.224385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] PATH_INFO: `/v3/users/7bfee0bbb6b0433ab45f2741bb4d6cb2` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.226134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bfee0bbb6b0433ab45f2741bb4d6cb2)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.231837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1048/2097] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:09 2022] POST /identity/v3/users => generated 285 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:10.231990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.232099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.242917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce71be-a071-4fac-98e0-ca389bcae56c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.247950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.248657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.248995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.249384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.250093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.251848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.266667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1049/2098] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:10.266667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.274495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989dfd7-f4a4-47e5-ac00-8fdccce622f4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.280031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.280598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.280885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.281145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.281812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.283463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.293922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1050/2099] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:10.294821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.305254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7faa9-a96e-43be-a5fb-73ed2d66d5ea admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.309789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.311051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.311051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.311244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.311681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.313234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.322812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1051/2100] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:10.323682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.333526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f46cf-a297-4114-ba0a-b121cc4ddba1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.338079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.338692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.338965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.339233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] PATH_INFO: `/v3/projects/4e3b38b64c85492b87236461cd7e3690/users/d98e47b16bd94123814fd518b95325db/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.354757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3b38b64c85492b87236461cd7e3690, user_id=d98e47b16bd94123814fd518b95325db, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.357696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.507371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1052/2101] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:10 2022] PUT /identity/v3/projects/4e3b38b64c85492b87236461cd7e3690/users/d98e47b16bd94123814fd518b95325db/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:10.508174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.551878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bfee0bbb6b0433ab45f2741bb4d6cb2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:10.552562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bfee0bbb6b0433ab45f2741bb4d6cb2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:10.553173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bfee0bbb6b0433ab45f2741bb4d6cb2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:10.562124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bfee0bbb6b0433ab45f2741bb4d6cb2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:10.578242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55625d-4b74-4cec-847e-bdb4c7ee27ab admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.582916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.583562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.583836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.584127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] PATH_INFO: `/v3/projects/ef24152ef1ee40eda12a8dff7d8cd6c2/users/e19c10d95a634c2b8cdf26bdd3ef1abe/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.601657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef24152ef1ee40eda12a8dff7d8cd6c2, user_id=e19c10d95a634c2b8cdf26bdd3ef1abe, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.604364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.765266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bed1447-0fa5-4d50-906c-19d54df80b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bfee0bbb6b0433ab45f2741bb4d6cb2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:10.773255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1053/2102] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:10 2022] PUT /identity/v3/projects/ef24152ef1ee40eda12a8dff7d8cd6c2/users/e19c10d95a634c2b8cdf26bdd3ef1abe/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:10.773255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.774442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:10.802938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1050/2103] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:10 2022] DELETE /identity/v3/users/7bfee0bbb6b0433ab45f2741bb4d6cb2 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:10.804136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cd04d-b0b3-4ad4-89c2-f38283a15e53 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.804423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cd04d-b0b3-4ad4-89c2-f38283a15e53 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.804694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cd04d-b0b3-4ad4-89c2-f38283a15e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.839722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ab0cd04d-b0b3-4ad4-89c2-f38283a15e53 None None] MFA Rules not processed for user `e19c10d95a634c2b8cdf26bdd3ef1abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:10.840963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ab0cd04d-b0b3-4ad4-89c2-f38283a15e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:10.864575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1d97-cbf4-4dc9-b6af-cd0a5c1e7b2f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.919056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1051/2104] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:10.921087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.921487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.921833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.930875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.931497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.931956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.932267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.932941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.934607 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.962157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:10.962157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:10.962718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1054/2105] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:10.962718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.962718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:10.963340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1052/2106] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:10.968395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:10.970069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d1714-eba1-4fcf-ae3a-3d22e5ac82d2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.975250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5cfbe-c6d0-4ccf-b351-0be17244c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.975894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5cfbe-c6d0-4ccf-b351-0be17244c4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.976175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5cfbe-c6d0-4ccf-b351-0be17244c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.976438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5cfbe-c6d0-4ccf-b351-0be17244c4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.977062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5cfbe-c6d0-4ccf-b351-0be17244c4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.979018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5cfbe-c6d0-4ccf-b351-0be17244c4fb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:10.979520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45364-ed9b-407a-b89a-b4521fbd3b83 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:10.985179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:10.986074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:10.986357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:10.986626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] PATH_INFO: `/v3/projects/4e3b38b64c85492b87236461cd7e3690/users/d98e47b16bd94123814fd518b95325db/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:10.988644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3b38b64c85492b87236461cd7e3690, user_id=d98e47b16bd94123814fd518b95325db, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:10.991317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.001971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1053/2107] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:10 2022] PUT /identity/v3/projects/4e3b38b64c85492b87236461cd7e3690/users/d98e47b16bd94123814fd518b95325db/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:11.002927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.004384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.061557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f76d5-5d16-4ca6-a9e7-dfd7d5cbd342 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.065178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.065949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.066107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.066363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.077201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1055/2108] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:10 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:11.078394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.078936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.079218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.110635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] MFA Rules not processed for user `d98e47b16bd94123814fd518b95325db`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:11.118138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.132511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.133983 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.144724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1054/2109] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:11.145424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.155602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8f43-8650-41f0-af26-f2334aa81816 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.194590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1056/2110] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:11.206707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.208244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.221974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.222544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.222824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.223096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.223782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.225708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.268529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2225ee-5f11-4113-9b6e-c07a75f9b17a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.272256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.272935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.273231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.273507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.284327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.285897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.296895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1057/2111] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:11.321241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1055/2112] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:11 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:11.323519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.334371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649cf6d-10bd-4c4c-90a2-c4191987b907 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.339326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.339913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.340189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.340458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.341088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.343566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.354371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1058/2113] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:11.361902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.372132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773242-9bc9-44ba-8f1e-8bdb1bcd64e8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.378370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.379368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.379666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.379924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] PATH_INFO: `/v3/projects/98b0b218741e4baf9f82646e9b8a7be6/users/844a4c337a184538b393de8d871ae9cc/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.399800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b0b218741e4baf9f82646e9b8a7be6, user_id=844a4c337a184538b393de8d871ae9cc, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.403275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.494246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1056/2114] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:11 2022] PUT /identity/v3/projects/98b0b218741e4baf9f82646e9b8a7be6/users/844a4c337a184538b393de8d871ae9cc/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:11.498927 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.518801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ff1c-51ec-439b-b10f-b25c10c8fdee admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.546588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.587315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.589015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.589015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.589015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.589729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.591481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.608351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1059/2115] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:11.609478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.619861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76699d5b-1c93-46b1-9090-728a626d1c69 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.626518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3e693-f16a-4ded-b2c7-5840d5a81494 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.631227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.631840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.632029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.632185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.632381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.632703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.632990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.633295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] PATH_INFO: `/v3/projects/98b0b218741e4baf9f82646e9b8a7be6/users/844a4c337a184538b393de8d871ae9cc/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.634388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.635291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b0b218741e4baf9f82646e9b8a7be6, user_id=844a4c337a184538b393de8d871ae9cc, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.638142 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.653916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1060/2116] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:11 2022] PUT /identity/v3/projects/98b0b218741e4baf9f82646e9b8a7be6/users/844a4c337a184538b393de8d871ae9cc/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:11.662021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.664036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.713633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.715092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62698f2d-7a99-4900-9400-4931c88408f0 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.745522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1057/2117] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:11.745522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.745522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.745522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.761205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] MFA Rules not processed for user `844a4c337a184538b393de8d871ae9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:11.762779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.766603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a843-70d9-443e-be15-55e19151152e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.775840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.776634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.777007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.777345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] PATH_INFO: `/v3/projects/ca3e4ac03bc244f79379810eac7f40a4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.778505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3e4ac03bc244f79379810eac7f40a4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.782391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.864026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1058/2118] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:11.875466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:11.876828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:11.912444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:11.949892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c9e43-1c76-4043-af61-a1ad13685556 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:11.954872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28b1b-4619-4ef3-a0b9-71c38bf84f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:11.956850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28b1b-4619-4ef3-a0b9-71c38bf84f79 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:11.957133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28b1b-4619-4ef3-a0b9-71c38bf84f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:11.957459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28b1b-4619-4ef3-a0b9-71c38bf84f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:11.972306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a28b1b-4619-4ef3-a0b9-71c38bf84f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:11.974000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a28b1b-4619-4ef3-a0b9-71c38bf84f79 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:11.988778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1059/2119] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:12.002024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3e4ac03bc244f79379810eac7f40a4', 'request_id': 'req-ed8f2bb6-fee3-4310-be95-7329da7d29c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:12.177559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3e4ac03bc244f79379810eac7f40a4', 'request_id': 'req-ed8f2bb6-fee3-4310-be95-7329da7d29c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:12.185717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3e4ac03bc244f79379810eac7f40a4', 'request_id': 'req-ed8f2bb6-fee3-4310-be95-7329da7d29c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:12.199498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] The token cache is being invalidate because project ca3e4ac03bc244f79379810eac7f40a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:12.206477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:12.206477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ed8f2bb6-fee3-4310-be95-7329da7d29c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:12.206477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1061/2120] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:11 2022] DELETE /identity/v3/projects/ca3e4ac03bc244f79379810eac7f40a4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:12.210310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.210588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.210865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.241253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:12.241253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:12.335218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1060/2121] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:12.335542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.335542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.335542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.348091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:12.360383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:12.368837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1062/2122] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:12.373437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.383549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73937bb-0310-455c-aedc-9c922186c0c1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.388267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.388907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.389322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.389599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.390248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:12.390548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.392174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:12.405160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1061/2123] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:12.410031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.419556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2054b-1632-4e7d-a900-d5db06f1dcf2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.424747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.426006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.426006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.426006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.426581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.428697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:12.532041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.536166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:12.558900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1063/2124] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:12 2022] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:12.558900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.632128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4365297-6c30-4606-b872-38652a060885 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.675160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d33d9-766c-4eb8-82ab-c83e177dc668 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.680433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.681083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.681440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.681780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.682565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.684838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:12.694887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.695495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.696405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.696829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.698958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:12.766581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.768012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:12.777054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1062/2125] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:12.827616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1064/2126] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:12 2022] POST /identity/v3/users => generated 281 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:12.831760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.842389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9a03f-8f6c-40e5-ba0a-6b214160cb27 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.847219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.847809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.848086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.848356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.849027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.850652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:12.862078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1063/2127] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:12.866020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.876536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69886-b609-4205-84df-391c576f6a82 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.881589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c9f21-58b1-494c-b329-0f99b608cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.882196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c9f21-58b1-494c-b329-0f99b608cb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.882487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c9f21-58b1-494c-b329-0f99b608cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.882756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c9f21-58b1-494c-b329-0f99b608cb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.883442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c9f21-58b1-494c-b329-0f99b608cb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.885082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c9f21-58b1-494c-b329-0f99b608cb3d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:12.896163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1065/2128] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:12.900691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:12.911302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4c41-3d14-4a54-923c-d05ca734e299 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:12.915865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:12.916509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:12.916786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:12.917059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] PATH_INFO: `/v3/projects/d7cec8d0f4a44154b4a474ff8973ad99/users/9aad8cac4d7e4647bd1586d652ad3e07/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:12.933467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cec8d0f4a44154b4a474ff8973ad99, user_id=9aad8cac4d7e4647bd1586d652ad3e07, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:12.936833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:13.068305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1064/2129] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:12 2022] PUT /identity/v3/projects/d7cec8d0f4a44154b4a474ff8973ad99/users/9aad8cac4d7e4647bd1586d652ad3e07/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:13.079852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:13.080136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:13.080420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:13.113131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] MFA Rules not processed for user `9aad8cac4d7e4647bd1586d652ad3e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:13.114460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:13.196922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1066/2130] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:13.255442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:13.257321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:13.327690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1988a-4fb9-452f-baf3-e1f55168061c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:13.327690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1a22c-9a85-4b53-be7c-879a0a888e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:13.328324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1a22c-9a85-4b53-be7c-879a0a888e38 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:13.328452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1a22c-9a85-4b53-be7c-879a0a888e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:13.328676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1a22c-9a85-4b53-be7c-879a0a888e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:13.342822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1a22c-9a85-4b53-be7c-879a0a888e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:13.345363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1a22c-9a85-4b53-be7c-879a0a888e38 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:13.356552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1065/2131] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:13.372623 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:13.435416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b882e0e-1475-47a0-8bf6-8bfb8eb36e8d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:13.439954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:13.440677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:13.440945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:13.441358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] PATH_INFO: `/v3/users/9aad8cac4d7e4647bd1586d652ad3e07` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:13.442481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aad8cac4d7e4647bd1586d652ad3e07)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:13.444411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:13.745020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aad8cac4d7e4647bd1586d652ad3e07'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:13.745800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aad8cac4d7e4647bd1586d652ad3e07'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:13.844817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aad8cac4d7e4647bd1586d652ad3e07'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:13.854900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aad8cac4d7e4647bd1586d652ad3e07'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:13.855800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aad8cac4d7e4647bd1586d652ad3e07'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:13.892301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1067/2132] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:13 2022] DELETE /identity/v3/users/9aad8cac4d7e4647bd1586d652ad3e07 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:13.896778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:13.897260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:13.897354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:13.919069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:13.921126 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:14.009136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1066/2133] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:14.021569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:14.030073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:14.087698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d755a-ff1e-4cca-8910-5b1bbf9feeb8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:14.091346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b86298-661e-4f79-ab3a-73cdd6fa54c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:14.092516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b86298-661e-4f79-ab3a-73cdd6fa54c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:14.092785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b86298-661e-4f79-ab3a-73cdd6fa54c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:14.093050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b86298-661e-4f79-ab3a-73cdd6fa54c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:14.102993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b86298-661e-4f79-ab3a-73cdd6fa54c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:14.104421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b86298-661e-4f79-ab3a-73cdd6fa54c5 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:14.114141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1068/2134] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:14.490519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:14.650530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:14.652003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:14.664999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb52944-55d7-45ce-b4bf-e704af793cd3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:14.670529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:14.671481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:14.671759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:14.672033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] PATH_INFO: `/v3/projects/d7cec8d0f4a44154b4a474ff8973ad99` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:14.673174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cec8d0f4a44154b4a474ff8973ad99)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:14.675119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:14.814363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cec8d0f4a44154b4a474ff8973ad99', 'request_id': 'req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:14.819999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cec8d0f4a44154b4a474ff8973ad99', 'request_id': 'req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:14.875718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cec8d0f4a44154b4a474ff8973ad99', 'request_id': 'req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:14.887766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] The token cache is being invalidate because project d7cec8d0f4a44154b4a474ff8973ad99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:14.888056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:14.889321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2f21a79c-e9e2-49c6-a8d0-b65d010d704e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:14.890829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1067/2135] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:14 2022] DELETE /identity/v3/projects/d7cec8d0f4a44154b4a474ff8973ad99 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:14.895698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:14.896003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:14.896297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:14.918985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:14.920482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:15.016728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1069/2136] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:15.024650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.025253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.026218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.042424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:15.056610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:15.057953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:15.081377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1068/2137] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:15.084396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.109284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbe853-6dff-4321-9ce2-197453f47529 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.115777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.116390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.116663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.117493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.117779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:15.118082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.119751 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:15.139883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1070/2138] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:15.140907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.150822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22abbed-2dbb-4bb2-a662-181e0d23456f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.157680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.158473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.158757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.159138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.160047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.163082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:15.332436 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1069/2139] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:15 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:15.337443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.348743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65f896-329f-460c-bf42-bd187d8daf8b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.407292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.407895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.408171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.408435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.409116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.411007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:15.553557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1071/2140] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:15 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:15.557576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.568560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271024-68ec-4279-b237-2cfafa048bcf admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.574517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.574517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.574517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.574517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.575142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.576826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:15.587610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1070/2141] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:15.591839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.602568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808a281-f2e5-46f1-b6e3-50a9ff9d5829 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.607167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21c2b3-303d-4a8a-8b96-34f96d6e66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.608894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c2b3-303d-4a8a-8b96-34f96d6e66ff admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.609172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c2b3-303d-4a8a-8b96-34f96d6e66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.609478 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c2b3-303d-4a8a-8b96-34f96d6e66ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.610115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21c2b3-303d-4a8a-8b96-34f96d6e66ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.611874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21c2b3-303d-4a8a-8b96-34f96d6e66ff admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:15.627324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1072/2142] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:15.629786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.640827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536e21c-4843-4eac-bf7c-4aaf615e7e92 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.645398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.646104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.646378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.646641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] PATH_INFO: `/v3/projects/1d1a36c496374d899cf03c4357291098/users/8a58930458f24507a9bc3850fd68ba9a/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.662600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1a36c496374d899cf03c4357291098, user_id=8a58930458f24507a9bc3850fd68ba9a, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.665758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:15.776167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1071/2143] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:15 2022] PUT /identity/v3/projects/1d1a36c496374d899cf03c4357291098/users/8a58930458f24507a9bc3850fd68ba9a/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:15.787310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.787716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.788063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.819810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] MFA Rules not processed for user `8a58930458f24507a9bc3850fd68ba9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:15.821043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:15.897512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1073/2144] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:15.910222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:15.912090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:15.976451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd37d3-e8cd-4ae6-93dc-3e3f2a6e912c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:15.980335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63208d-fde4-4de2-9365-96707da7d5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:15.980948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63208d-fde4-4de2-9365-96707da7d5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:15.981253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63208d-fde4-4de2-9365-96707da7d5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:15.981530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63208d-fde4-4de2-9365-96707da7d5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:15.992562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63208d-fde4-4de2-9365-96707da7d5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:15.994205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63208d-fde4-4de2-9365-96707da7d5a4 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:16.005203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1072/2145] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:16.926976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:16.930484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:17.021453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64722f0-ab4c-458e-ad98-3eae878ec9ee None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:17.032458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:17.033196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:17.033593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:17.033931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] PATH_INFO: `/v3/users/e19c10d95a634c2b8cdf26bdd3ef1abe` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:17.035138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19c10d95a634c2b8cdf26bdd3ef1abe)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:17.037248 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:17.368955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19c10d95a634c2b8cdf26bdd3ef1abe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:17.370592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19c10d95a634c2b8cdf26bdd3ef1abe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:17.562947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19c10d95a634c2b8cdf26bdd3ef1abe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:17.569805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19c10d95a634c2b8cdf26bdd3ef1abe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:17.573925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19c10d95a634c2b8cdf26bdd3ef1abe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:17.602497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1074/2146] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:16 2022] DELETE /identity/v3/users/e19c10d95a634c2b8cdf26bdd3ef1abe => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:17.611882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:17.612743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:17.613168 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:17.632599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:17.634006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:17.694923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1073/2147] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:17.705152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:17.707047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:17.770123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555f23-c77a-4ad1-9162-94695c16a10c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:17.774080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:17.774736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:17.775016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:17.775283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:17.785333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:17.786881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:17.797300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1075/2148] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:17.850757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:18.216137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:18.277854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:18.278669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:18.291917 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb024d4-5b2c-46b9-a532-98141a47e773 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:18.298513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:18.299394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:18.299826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:18.300345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] PATH_INFO: `/v3/projects/ef24152ef1ee40eda12a8dff7d8cd6c2` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:18.302034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef24152ef1ee40eda12a8dff7d8cd6c2)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:18.306629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:18.479058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef24152ef1ee40eda12a8dff7d8cd6c2', 'request_id': 'req-905f1fc4-4997-4da0-b8a9-197b34c74b1a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:18.485495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef24152ef1ee40eda12a8dff7d8cd6c2', 'request_id': 'req-905f1fc4-4997-4da0-b8a9-197b34c74b1a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:18.629378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef24152ef1ee40eda12a8dff7d8cd6c2', 'request_id': 'req-905f1fc4-4997-4da0-b8a9-197b34c74b1a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:18.654764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] The token cache is being invalidate because project ef24152ef1ee40eda12a8dff7d8cd6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:18.655322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:18.656338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:18.658470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1074/2149] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:18 2022] DELETE /identity/v3/projects/ef24152ef1ee40eda12a8dff7d8cd6c2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:18.662395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:18.679152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d19c7-848f-49b6-b9b0-b8ed835361f6 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:18.765006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:18.765813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:18.766091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:18.766363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] PATH_INFO: `/v3/users/844a4c337a184538b393de8d871ae9cc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:18.767473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844a4c337a184538b393de8d871ae9cc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:18.769442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:18.982951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844a4c337a184538b393de8d871ae9cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:18.983800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844a4c337a184538b393de8d871ae9cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.049924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844a4c337a184538b393de8d871ae9cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.057795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844a4c337a184538b393de8d871ae9cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.058373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8637b828-2c2d-477d-a2da-dc1b44fb20e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844a4c337a184538b393de8d871ae9cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.077562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1076/2150] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:18 2022] DELETE /identity/v3/users/844a4c337a184538b393de8d871ae9cc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:19.549773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:19.551309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:19.575609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1fc4-4997-4da0-b8a9-197b34c74b1a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:19.651024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:19.651720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:19.652041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:19.652316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] PATH_INFO: `/v3/projects/98b0b218741e4baf9f82646e9b8a7be6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:19.653566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b0b218741e4baf9f82646e9b8a7be6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:19.655613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:19.736289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:19.775053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b0b218741e4baf9f82646e9b8a7be6', 'request_id': 'req-d5af49c8-f5bc-41f9-808f-6c112ff3484e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.791249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b0b218741e4baf9f82646e9b8a7be6', 'request_id': 'req-d5af49c8-f5bc-41f9-808f-6c112ff3484e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.880960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b0b218741e4baf9f82646e9b8a7be6', 'request_id': 'req-d5af49c8-f5bc-41f9-808f-6c112ff3484e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.889778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] The token cache is being invalidate because project 98b0b218741e4baf9f82646e9b8a7be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:19.890654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.891522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d5af49c8-f5bc-41f9-808f-6c112ff3484e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:19.893138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1075/2151] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:19 2022] DELETE /identity/v3/projects/98b0b218741e4baf9f82646e9b8a7be6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:19.897942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:19.898228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:19.898505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:19.919508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:19.924355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:19.994177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1077/2152] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:20.002354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.002662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.003089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.050026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:20.051266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:20.070191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1076/2153] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:20.072024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.085463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2429-9b6b-4109-ba78-b7e235321462 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.092216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.097514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.097514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.097514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.097514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:20.097514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.097514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:20.110629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1078/2154] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:20.115090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.125137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a446b-b900-4b7c-9e85-4ae31bba160e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.130148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.130759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.131041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.131311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.131950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.134189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:20.254479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:20.263309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1077/2155] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:20 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:20.266182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.276411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db000-1282-4a70-b592-61f49fb65903 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.336965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.336965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.337339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.337727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.338888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.342715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:20.537693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1079/2156] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:20 2022] POST /identity/v3/users => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:20.541889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.553026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5829-c3a3-4882-9536-6d89cc037e45 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.557540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.558121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.558395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.558658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.559288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.561174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:20.570834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1078/2157] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:20.577552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.588166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662d0c-ba91-4172-a57f-c6f38c3e40cd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.592682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623208-cbe8-4cf3-af70-67fc93d0b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.593298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623208-cbe8-4cf3-af70-67fc93d0b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.594202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623208-cbe8-4cf3-af70-67fc93d0b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.594358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623208-cbe8-4cf3-af70-67fc93d0b2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.595327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d623208-cbe8-4cf3-af70-67fc93d0b2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.596963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d623208-cbe8-4cf3-af70-67fc93d0b2f5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:20.607489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1080/2158] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:20.613106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.623966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9307fb-7327-4e51-8a59-2f10d76ca4c2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.628797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.629485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.629767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.630043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] PATH_INFO: `/v3/projects/d6ae58a99b4b4f4dbf3bdad208e285b5/users/4cc5029f8bd14d4f9cfc6ca3493a878f/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.646815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ae58a99b4b4f4dbf3bdad208e285b5, user_id=4cc5029f8bd14d4f9cfc6ca3493a878f, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.649669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:20.752930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1079/2159] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:20 2022] PUT /identity/v3/projects/d6ae58a99b4b4f4dbf3bdad208e285b5/users/4cc5029f8bd14d4f9cfc6ca3493a878f/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:20.764970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.765486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.766128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.798234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] MFA Rules not processed for user `4cc5029f8bd14d4f9cfc6ca3493a878f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:20.798575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:20.869964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1081/2160] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:20.875750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:20.959565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0f915-3cfa-4661-9e21-97a3c976e925 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:20.964659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:20.965408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:20.965758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:20.966100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:20.966838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:20.969965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.092724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1080/2161] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:20 2022] POST /identity/v3/projects => generated 399 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:21.095342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.110091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494fb8a-5ef6-4db7-96be-84f2e8de4dc8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.176200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322413c3-d7a9-43db-8bd8-d07d4bf05a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.176894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322413c3-d7a9-43db-8bd8-d07d4bf05a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.177185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322413c3-d7a9-43db-8bd8-d07d4bf05a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.177485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322413c3-d7a9-43db-8bd8-d07d4bf05a92 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.178116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322413c3-d7a9-43db-8bd8-d07d4bf05a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.180319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322413c3-d7a9-43db-8bd8-d07d4bf05a92 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.339664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1082/2162] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:21 2022] POST /identity/v3/users => generated 306 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:21.343012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.354507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62ba8-4c9e-4d45-ae75-da11dfad2329 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.361530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.361849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.361982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.362232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.362453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.363055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.363616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.364573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.366623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.379533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1081/2163] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:21.384546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.385425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:21.386819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:21.396885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faf1f0-bc21-4a37-944e-1bd1d389010d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.402685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.403339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.403620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.403895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] PATH_INFO: `/v3/projects/528459f29adb4b7e97be5fe285f86877/users/684d9b9e38cb405fad4614ac4c53dff6/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.419427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=528459f29adb4b7e97be5fe285f86877, user_id=684d9b9e38cb405fad4614ac4c53dff6, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.422767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.444291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1083/2164] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:21.490367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.493408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:21.519347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1082/2165] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:21 2022] PUT /identity/v3/projects/528459f29adb4b7e97be5fe285f86877/users/684d9b9e38cb405fad4614ac4c53dff6/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:21.525892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.569778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd253a3-3a55-47fe-8201-ea6b3599defb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.600403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:21.630427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb132-26e5-49fb-9409-4f4e2cc50d1a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.642991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.643842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.644244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.644758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.645593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.647249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.660087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.668730 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1083/2166] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:21.669038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.669038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.669038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.669464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.679389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45c8f-1eae-449e-b6c1-f8aff80abe4b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.686963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff28d7b-6055-4a90-baac-ed47dd24d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.687707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff28d7b-6055-4a90-baac-ed47dd24d0df admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.687996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff28d7b-6055-4a90-baac-ed47dd24d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.688311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff28d7b-6055-4a90-baac-ed47dd24d0df admin admin] PATH_INFO: `/v3/projects/528459f29adb4b7e97be5fe285f86877/users/684d9b9e38cb405fad4614ac4c53dff6/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.690383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff28d7b-6055-4a90-baac-ed47dd24d0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=528459f29adb4b7e97be5fe285f86877, user_id=684d9b9e38cb405fad4614ac4c53dff6, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.693170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff28d7b-6055-4a90-baac-ed47dd24d0df admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.725264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1084/2167] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:21 2022] PUT /identity/v3/projects/528459f29adb4b7e97be5fe285f86877/users/684d9b9e38cb405fad4614ac4c53dff6/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:21.727374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.727769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.728182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.735410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.737628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.747705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1084/2168] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 11:47:21.771881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] MFA Rules not processed for user `684d9b9e38cb405fad4614ac4c53dff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:21.772924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:21.784795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:21.845600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1085/2169] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:21.856503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:21.857992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:21.920689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b538356-8531-4b20-a99b-b6fb6832b697 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:21.978166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283cb65-f921-47d7-9720-4a83e6fa3601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:21.978760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283cb65-f921-47d7-9720-4a83e6fa3601 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:21.979053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283cb65-f921-47d7-9720-4a83e6fa3601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:21.979299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283cb65-f921-47d7-9720-4a83e6fa3601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:21.988361 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283cb65-f921-47d7-9720-4a83e6fa3601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:21.989924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283cb65-f921-47d7-9720-4a83e6fa3601 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:21.999080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1085/2170] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:22.299588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:22.301058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:22.318803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7864a-06be-4511-9a5f-62042e7fbb6f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:22.322823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:22.324225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:22.324225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:22.324225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:22.393987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:22.402215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:22.412769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1086/2171] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:22 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:22.813166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066e1e-250e-41b6-91a2-27392c0ee609 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:22.813554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066e1e-250e-41b6-91a2-27392c0ee609 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:22.813835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066e1e-250e-41b6-91a2-27392c0ee609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:22.833916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a5066e1e-250e-41b6-91a2-27392c0ee609 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:22.835324 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a5066e1e-250e-41b6-91a2-27392c0ee609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:22.897807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1086/2172] 10.222.0.64 () {58 vars in 967 bytes} [Fri Sep 9 11:47:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:22.912588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:22.944180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:22.998576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e98e3-0a0a-486b-8bd8-7ae4e4688b3d service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:23.004324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:23.004993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:23.005297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:23.005571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:23.013785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:23.017893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:23.030455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1087/2173] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:47:23.148370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:23.794731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b56a5-1486-4eb3-a3e4-c86be62e7dd5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:23.794846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b56a5-1486-4eb3-a3e4-c86be62e7dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:23.795057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b56a5-1486-4eb3-a3e4-c86be62e7dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:23.817662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e93b56a5-1486-4eb3-a3e4-c86be62e7dd5 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:23.829809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e93b56a5-1486-4eb3-a3e4-c86be62e7dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:23.830740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1087/2174] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:23.851453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:23.865759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f5a2c-c013-45bf-8657-8dbd11f97a60 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:23.875862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:23.877898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:23.878451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:23.879458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:23.898099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:23.899856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:23.921471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1088/2175] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:47:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:47:24.760903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:24.760903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:24.762021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:24.786456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:24.787639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:24.794870 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1088/2176] 10.222.0.64 () {58 vars in 967 bytes} [Fri Sep 9 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:24.808048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:24.819228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70cd01-e9dd-4348-9899-6f4696b21f71 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:24.824446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:24.825036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:24.825388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:24.825663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:24.835237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:24.836887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:24.847354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1089/2177] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:47:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 11:47:25.307466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:25.778731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:27.462890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:27.781806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:27.824894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:27.848381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaee45-aa28-4924-a2c1-ed29cc774534 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:27.852916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:27.853566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:27.853846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:27.854115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] PATH_INFO: `/v3/users/4cc5029f8bd14d4f9cfc6ca3493a878f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:27.855222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc5029f8bd14d4f9cfc6ca3493a878f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:27.857148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:28.021747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:28.023349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:28.036979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4b2d-685c-4b2b-92fc-6ee9c025bf39 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:28.041482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:28.042096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:28.042372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:28.042639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] PATH_INFO: `/v3/users/61476c5817684d6a9d9299c7e81cd4b3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:28.043736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=61476c5817684d6a9d9299c7e81cd4b3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:28.045674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:28.106372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc5029f8bd14d4f9cfc6ca3493a878f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.107014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc5029f8bd14d4f9cfc6ca3493a878f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.210775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc5029f8bd14d4f9cfc6ca3493a878f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.219845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc5029f8bd14d4f9cfc6ca3493a878f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.220697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9399e7c1-8a7d-48e0-b859-360bc0e0c61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc5029f8bd14d4f9cfc6ca3493a878f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.243942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1089/2178] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:27 2022] DELETE /identity/v3/users/4cc5029f8bd14d4f9cfc6ca3493a878f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:28.251128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:28.251418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:28.251692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:28.271473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:28.272682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:28.300826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61476c5817684d6a9d9299c7e81cd4b3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.301520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61476c5817684d6a9d9299c7e81cd4b3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.302321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61476c5817684d6a9d9299c7e81cd4b3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.310271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61476c5817684d6a9d9299c7e81cd4b3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.333242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1090/2179] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:28.342876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:28.344551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:28.378165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8caee586-4bfc-4e1d-b557-7aaa7cec76dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61476c5817684d6a9d9299c7e81cd4b3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.398039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1090/2180] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:28 2022] DELETE /identity/v3/users/61476c5817684d6a9d9299c7e81cd4b3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:28.406742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:28.407721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:28.407943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:28.412716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc76479-9241-4a7a-aca0-a4af0e351f8c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:28.431322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:28.432571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:28.466187 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:28.466793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:28.467066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:28.467334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:28.502769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1091/2181] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:28.513389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:28.514876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:28.527755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e53766-68e6-49fa-a90b-e6f0d4a0878c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:28.531732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:28.535444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:28.535444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:28.535444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:28.544722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:28.546358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:28.557574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:28.558495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1092/2182] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:28.562977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:28.573799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1091/2183] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:28.820252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:28.821837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:28.837291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8082106-b18f-469d-a921-05c4c5040e12 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:28.842773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:28.843666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:28.844297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:28.844297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] PATH_INFO: `/v3/projects/aeaa431cd1ed43bc993946d00fe74a6d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:28.845442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeaa431cd1ed43bc993946d00fe74a6d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:28.847401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:28.964936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:28.972696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeaa431cd1ed43bc993946d00fe74a6d', 'request_id': 'req-e34f2716-c16b-42fe-a995-73d44c2cb355'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:28.978276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeaa431cd1ed43bc993946d00fe74a6d', 'request_id': 'req-e34f2716-c16b-42fe-a995-73d44c2cb355'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.057997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeaa431cd1ed43bc993946d00fe74a6d', 'request_id': 'req-e34f2716-c16b-42fe-a995-73d44c2cb355'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.066314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:29.068124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:29.072555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] The token cache is being invalidate because project aeaa431cd1ed43bc993946d00fe74a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:29.072872 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.073546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.075286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1093/2184] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:28 2022] DELETE /identity/v3/projects/aeaa431cd1ed43bc993946d00fe74a6d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:29.087826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf619c1e-9199-4763-a8cb-7cb038239db2 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:29.156912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:29.157590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:29.157863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:29.158158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] PATH_INFO: `/v3/projects/d6ae58a99b4b4f4dbf3bdad208e285b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:29.159338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ae58a99b4b4f4dbf3bdad208e285b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:29.161511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:29.292482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ae58a99b4b4f4dbf3bdad208e285b5', 'request_id': 'req-335037ff-45aa-4afe-ae23-4bf234a67440'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.421145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ae58a99b4b4f4dbf3bdad208e285b5', 'request_id': 'req-335037ff-45aa-4afe-ae23-4bf234a67440'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.427938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ae58a99b4b4f4dbf3bdad208e285b5', 'request_id': 'req-335037ff-45aa-4afe-ae23-4bf234a67440'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.439202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] The token cache is being invalidate because project d6ae58a99b4b4f4dbf3bdad208e285b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:29.439485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.440119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.441660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1092/2185] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:29 2022] DELETE /identity/v3/projects/d6ae58a99b4b4f4dbf3bdad208e285b5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:29.445910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:29.447318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:29.461035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2716-c16b-42fe-a995-73d44c2cb355 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:29.528671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:29.528671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:29.528671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:29.528671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] PATH_INFO: `/v3/users/684d9b9e38cb405fad4614ac4c53dff6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:29.529812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=684d9b9e38cb405fad4614ac4c53dff6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:29.529812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:29.727081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684d9b9e38cb405fad4614ac4c53dff6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.727760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684d9b9e38cb405fad4614ac4c53dff6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.728373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684d9b9e38cb405fad4614ac4c53dff6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.735464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684d9b9e38cb405fad4614ac4c53dff6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.812806 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36561c8e-3dfa-4fd5-8a72-6ccc8fffce6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684d9b9e38cb405fad4614ac4c53dff6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:29.835159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1094/2186] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:29 2022] DELETE /identity/v3/users/684d9b9e38cb405fad4614ac4c53dff6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:30.079374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:30.372079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:30.373831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:30.390843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335037ff-45aa-4afe-ae23-4bf234a67440 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:30.453616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:30.455365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:30.455642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:30.455944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] PATH_INFO: `/v3/projects/528459f29adb4b7e97be5fe285f86877` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:30.457121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=528459f29adb4b7e97be5fe285f86877)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:30.459261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:30.588317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528459f29adb4b7e97be5fe285f86877', 'request_id': 'req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:30.684491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528459f29adb4b7e97be5fe285f86877', 'request_id': 'req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:30.691730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528459f29adb4b7e97be5fe285f86877', 'request_id': 'req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:30.704686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] The token cache is being invalidate because project 528459f29adb4b7e97be5fe285f86877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:30.704990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:30.705670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-43be5c14-5bd0-4c57-87f8-5ed332c7d65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:30.707196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1093/2187] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:30 2022] DELETE /identity/v3/projects/528459f29adb4b7e97be5fe285f86877 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:30.712562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:30.713002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:30.713175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:30.734949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:30.736233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:30.802547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1095/2188] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:30.811293 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:30.811598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:30.811855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:30.838118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:30.838118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:30.842425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1094/2189] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:30.847296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:30.856890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da861d-7b99-48e9-b008-b71399c99be6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:30.861879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:30.862544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:30.862949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:30.863250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:30.863921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:30.864220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:30.866025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:30.880640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1096/2190] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:30.884963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:30.895224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd6856-fe1d-4052-b5c3-b3552fc430da None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:30.900190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:30.900785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:30.901081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:30.901415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:30.902126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:30.904066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:31.034919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1095/2191] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:30 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:31.036336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:31.047518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7a26-8a71-447f-bf03-dde08702820b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:31.105429 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:31.106002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:31.106280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:31.106545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:31.107211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:31.109661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:31.204984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1097/2192] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:31 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:31.209761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:31.220873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf18b5-e651-4663-bb0a-6c444286a61f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:31.225454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:31.226045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:31.226318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:31.226583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:31.227339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:31.228933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:31.239798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1096/2193] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:31.243777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:31.255463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60666-c1fc-4ba0-8e46-c6733097ecac admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:31.261745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ea9d-d626-4259-905e-3efca3bf2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:31.261745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ea9d-d626-4259-905e-3efca3bf2ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:31.261745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ea9d-d626-4259-905e-3efca3bf2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:31.261745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ea9d-d626-4259-905e-3efca3bf2ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:31.262222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2ea9d-d626-4259-905e-3efca3bf2ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:31.263443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2ea9d-d626-4259-905e-3efca3bf2ea0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:31.274568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1098/2194] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:31.278974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:31.290233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec7f67-6a4c-4824-9e90-6a4367f0c1f9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:31.294985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:31.295641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:31.295920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:31.296244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] PATH_INFO: `/v3/projects/4eb9693a81f3457087863887c0a4a1ab/users/3cfbacf7531e45eb818f7a775364c4f9/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:31.311714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb9693a81f3457087863887c0a4a1ab, user_id=3cfbacf7531e45eb818f7a775364c4f9, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:31.314635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:31.407583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1097/2195] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:31 2022] PUT /identity/v3/projects/4eb9693a81f3457087863887c0a4a1ab/users/3cfbacf7531e45eb818f7a775364c4f9/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:31.417855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:31.418146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:31.418418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:31.447157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] MFA Rules not processed for user `3cfbacf7531e45eb818f7a775364c4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:31.448382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:31.519263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1099/2196] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:31.535948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:31.542716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:31.632912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21b3d2-9783-452b-a415-24714db70631 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:31.638593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:31.639468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:31.639845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:31.640860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:31.655917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:31.658309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:31.658720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:31.672602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1098/2197] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:33.690343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:35.142178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:36.585549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:36.587646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:36.638452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:36.668072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae43e6-5814-4f6d-aac1-53398a1a883f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:36.672819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:36.673472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:36.673937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:36.674067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] PATH_INFO: `/v3/users/8a58930458f24507a9bc3850fd68ba9a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:36.675147 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a58930458f24507a9bc3850fd68ba9a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:36.677257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:36.735424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:36.736861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:36.754441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398060-2925-484e-9ebf-6529e89e10ee service glance] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:36.760972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:36.767793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:36.767793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:36.767793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] PATH_INFO: `/v3/users/e2c7d036eabf4c57876680aa9172ce0e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:36.770286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c7d036eabf4c57876680aa9172ce0e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:36.772352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:36.895034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a58930458f24507a9bc3850fd68ba9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:36.895761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a58930458f24507a9bc3850fd68ba9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:36.896354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a58930458f24507a9bc3850fd68ba9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:36.903787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a58930458f24507a9bc3850fd68ba9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.012269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8df9f58d-7ad2-4ccb-bf59-bcc5705dfc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a58930458f24507a9bc3850fd68ba9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.034799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1100/2198] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:36 2022] DELETE /identity/v3/users/8a58930458f24507a9bc3850fd68ba9a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:37.036348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:37.036697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:37.036980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:37.062865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:37.064396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:37.086082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c7d036eabf4c57876680aa9172ce0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.087398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c7d036eabf4c57876680aa9172ce0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.151212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1101/2199] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:37.161413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:37.176525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:37.194566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c7d036eabf4c57876680aa9172ce0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.203810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c7d036eabf4c57876680aa9172ce0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.204910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f0dfe44e-bbfb-4af0-a32d-cca8c2e08b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c7d036eabf4c57876680aa9172ce0e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:37.231006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1099/2200] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:36 2022] DELETE /identity/v3/users/e2c7d036eabf4c57876680aa9172ce0e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:37.236264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:37.236550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:37.237109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:37.249006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5857de4-4b40-4b00-9ef3-91bbb1689ec6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:37.263343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:37.264558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:37.300956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:37.302011 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:37.302259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:37.302534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:37.304498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:37.326933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1100/2201] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:37.336768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:37.339716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:37.352583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe4bdc-bd88-4bed-9e3a-f73fb0b45772 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:37.356552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:37.357154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:37.357467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:37.357740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:37.368286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:37.369777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:37.372218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:37.373898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:37.380413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1101/2202] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:47:37.385376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1102/2203] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:37.583691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:38.002728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.004638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:38.021012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250b5e-4a1c-488f-868f-a4f13785fa6b service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.037656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.038168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.038457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.039182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.039301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] PATH_INFO: `/v3/projects/ee737894c70845edaea4289c88b254ff` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.040463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:38.040587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee737894c70845edaea4289c88b254ff)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.042812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.059471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61482d-5269-48ce-85da-470674f33087 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.065718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.066525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.067302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.067651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] PATH_INFO: `/v3/projects/1d1a36c496374d899cf03c4357291098` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.069015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1a36c496374d899cf03c4357291098)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.071513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.178368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee737894c70845edaea4289c88b254ff', 'request_id': 'req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.218759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1a36c496374d899cf03c4357291098', 'request_id': 'req-5558c99a-aedd-42ae-bbb1-8aba7f277984'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.224728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1a36c496374d899cf03c4357291098', 'request_id': 'req-5558c99a-aedd-42ae-bbb1-8aba7f277984'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.278474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee737894c70845edaea4289c88b254ff', 'request_id': 'req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.284850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee737894c70845edaea4289c88b254ff', 'request_id': 'req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.297170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] The token cache is being invalidate because project ee737894c70845edaea4289c88b254ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:38.297622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.298294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.299818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1102/2204] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:38 2022] DELETE /identity/v3/projects/ee737894c70845edaea4289c88b254ff => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:38.303655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.305058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:38.374987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ecb0b-48d0-47bb-ad6c-718e4e6ef377 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.431578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.432204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.432441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.432719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] PATH_INFO: `/v3/users/d98e47b16bd94123814fd518b95325db` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.433964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98e47b16bd94123814fd518b95325db)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.434518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1a36c496374d899cf03c4357291098', 'request_id': 'req-5558c99a-aedd-42ae-bbb1-8aba7f277984'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.435971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.448037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] The token cache is being invalidate because project 1d1a36c496374d899cf03c4357291098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:38.448331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.448999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5558c99a-aedd-42ae-bbb1-8aba7f277984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.450554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1103/2205] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:38 2022] DELETE /identity/v3/projects/1d1a36c496374d899cf03c4357291098 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:38.455312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cacdaa-268b-42a8-92df-15f7217ec924 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.455931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cacdaa-268b-42a8-92df-15f7217ec924 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.455931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cacdaa-268b-42a8-92df-15f7217ec924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.475595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-15cacdaa-268b-42a8-92df-15f7217ec924 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:38.476811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-15cacdaa-268b-42a8-92df-15f7217ec924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:38.485339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1104/2206] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:38.496849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.497131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.497438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.517486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:38.518753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:38.527285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1105/2207] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:38.531450 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.540481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49039b21-baab-48cc-85b5-2d847e0f546f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.545006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.545610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.546373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.546709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.547350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:38.547641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.549572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.561082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1106/2208] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:47:38.565916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.575552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da546692-b4cc-4469-91d7-98ba3dc1c174 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.580329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.581042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.581422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.581792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.582666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.591248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.705626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98e47b16bd94123814fd518b95325db'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.706276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98e47b16bd94123814fd518b95325db'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.728580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:38.735399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1107/2209] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:38 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:38.739565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.802024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94dbd1-d0de-4a8f-af6e-e3d6abaa308e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.806074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98e47b16bd94123814fd518b95325db'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.806802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.807411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.807690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.807963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.808620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.810571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.814166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98e47b16bd94123814fd518b95325db'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.814831 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98e47b16bd94123814fd518b95325db'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:38.833471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1103/2210] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:38 2022] DELETE /identity/v3/users/d98e47b16bd94123814fd518b95325db => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:38.893081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1108/2211] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:38 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:38.897319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:38.898764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:38.966875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed69a1-b8ae-4ea3-bd49-9e3ed8f5dc43 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:38.972777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:38.973415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:38.973694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:38.973966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:38.974613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:38.976262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:38.988287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1104/2212] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:38.993542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.005371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b1c46-5e3d-47b0-871e-449eaf93720b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.042773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf0f85-f612-4a5f-8e1c-ba56142bcfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.045496 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0f85-f612-4a5f-8e1c-ba56142bcfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.045782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0f85-f612-4a5f-8e1c-ba56142bcfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.046094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0f85-f612-4a5f-8e1c-ba56142bcfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.046885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf0f85-f612-4a5f-8e1c-ba56142bcfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.049041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf0f85-f612-4a5f-8e1c-ba56142bcfe3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.066931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1109/2213] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:39.070944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.094568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a8187-ee81-402f-8c07-642d90de3656 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.097946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.098860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.099205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.099537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] PATH_INFO: `/v3/projects/083961a33eee4009aa1579832d2fd22d/users/9009041d1c4b4a4ca1d13e07f13d8104/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.118292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=083961a33eee4009aa1579832d2fd22d, user_id=9009041d1c4b4a4ca1d13e07f13d8104, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.122078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.229639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1105/2214] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:39 2022] PUT /identity/v3/projects/083961a33eee4009aa1579832d2fd22d/users/9009041d1c4b4a4ca1d13e07f13d8104/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:39.240665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.240950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.241236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.271414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] MFA Rules not processed for user `9009041d1c4b4a4ca1d13e07f13d8104`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:39.272623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:39.317808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.320596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:39.348855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1110/2215] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:39.371874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.439869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f243bd4-90d2-4322-b6b6-0f486610a20f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.446315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.447032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.447378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.447738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] PATH_INFO: `/v3/projects/4e3b38b64c85492b87236461cd7e3690` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.448940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3b38b64c85492b87236461cd7e3690)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.451157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.461407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75118ae8-bd8a-4f49-b8ae-c5fe8ade9ccb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.466729 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.467494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.468498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.469245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.470119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.472094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.561564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3b38b64c85492b87236461cd7e3690', 'request_id': 'req-7d29c786-f827-4e10-b575-7b7d5823114b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:39.590295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1111/2216] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:39.595508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.657696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3b38b64c85492b87236461cd7e3690', 'request_id': 'req-7d29c786-f827-4e10-b575-7b7d5823114b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:39.660164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780ce29-3742-4055-9d3f-f0a3f8947bf6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.664349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3b38b64c85492b87236461cd7e3690', 'request_id': 'req-7d29c786-f827-4e10-b575-7b7d5823114b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:39.664886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.668991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.668991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.668991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.668991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.668991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.676771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] The token cache is being invalidate because project 4e3b38b64c85492b87236461cd7e3690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:39.677040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:39.677714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d29c786-f827-4e10-b575-7b7d5823114b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:39.679402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1106/2217] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:39 2022] DELETE /identity/v3/projects/4e3b38b64c85492b87236461cd7e3690 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:39.684256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d724a-64bb-47c5-8bce-689cfee56547 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.687213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d724a-64bb-47c5-8bce-689cfee56547 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.687518 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d724a-64bb-47c5-8bce-689cfee56547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.708883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-248d724a-64bb-47c5-8bce-689cfee56547 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:39.710140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-248d724a-64bb-47c5-8bce-689cfee56547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:39.718605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1107/2218] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:39.726341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.726618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.726887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.750046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1112/2219] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:39.750271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:39.750271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:39.752645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.754340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:39.756510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1108/2220] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:39.760348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.767462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72232ce-046b-4872-9550-3f2bc0e9dfb3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.770323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9d1cc-f1ef-46a2-8179-719ea69b1f8c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.772127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.772725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.773007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.773310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.773956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.774978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.775556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.775762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.775852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.776083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.776717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:39.777016 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.778634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.779319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:39.788149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1113/2221] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:39.791356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1109/2222] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:47:39.791919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.795447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.802310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ad55-588e-4c7f-aa5f-b215693cc45e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.805971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebaac2-ab13-4f1a-98a1-3310fe7a98d9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.807226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.807847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.808119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.808388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.809047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.810866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.810996 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.812013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.812491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.812838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.813631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.819308 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.823828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1114/2223] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:39.829092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.840927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734517cb-7b16-484b-81ff-866d02ffecb9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:39.846127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b3872-aa60-43f0-8041-f6715e0bba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:39.846777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b3872-aa60-43f0-8041-f6715e0bba7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.847052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b3872-aa60-43f0-8041-f6715e0bba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.847320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b3872-aa60-43f0-8041-f6715e0bba7f admin admin] PATH_INFO: `/v3/projects/ef2f00c612ff457589d8cd81370c5fa5/users/adf8f3aca5b142e49ff042019325b497/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.862146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b3872-aa60-43f0-8041-f6715e0bba7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2f00c612ff457589d8cd81370c5fa5, user_id=adf8f3aca5b142e49ff042019325b497, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:39.865475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b3872-aa60-43f0-8041-f6715e0bba7f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:39.910400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1110/2224] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:39.914601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:39.941985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1115/2225] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:39 2022] PUT /identity/v3/projects/ef2f00c612ff457589d8cd81370c5fa5/users/adf8f3aca5b142e49ff042019325b497/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:39.953953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:39.954238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:39.954512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:39.983222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] MFA Rules not processed for user `adf8f3aca5b142e49ff042019325b497`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:39.989256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:39.989549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed900fe-25bb-4b3f-8d75-7b9e1e275ba6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.046453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.047336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.047669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.047946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.048569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.050579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.057906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1116/2226] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:40.063502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.074292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6fdb-8a3b-4e85-8c2e-8c30c97ea68d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.079515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.080117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.080395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.080665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.081907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.084163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.209416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1111/2227] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:39 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:40.217123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.251466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1117/2228] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:40 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:40.254843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38ce48-bff9-4c72-b4d4-272c3e54cc0e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.255771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.334211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec6323-697a-499e-a761-a9f6ff50d2f6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.347081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.347081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.348806 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.349200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.350165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.354302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.366910 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.367629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.368001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.368265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.369132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.371688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.384745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1112/2229] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:40.394075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.408576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94682ef3-f478-4c47-ad43-3809be9ac569 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.414152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.415539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.415539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.415539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.416035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.417717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.436138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1113/2230] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:40.441043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.451209 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edef1a-ffbe-41eb-8c61-16495db59de6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.456688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc821-6084-4ee0-a1b8-8e176f520554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.457376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc821-6084-4ee0-a1b8-8e176f520554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.457650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc821-6084-4ee0-a1b8-8e176f520554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.457918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc821-6084-4ee0-a1b8-8e176f520554 admin admin] PATH_INFO: `/v3/projects/8c3f412191554540b29993c83055f2cf/users/be3749791160492db5445551db3540f7/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.474255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc821-6084-4ee0-a1b8-8e176f520554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3f412191554540b29993c83055f2cf, user_id=be3749791160492db5445551db3540f7, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.476941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc821-6084-4ee0-a1b8-8e176f520554 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.507315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1118/2231] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:40 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:40.511092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.522176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0219ae5-4024-44ef-83e9-2a221af0f08c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.528838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.528838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.528838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.528838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.529236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.531673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.545621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1119/2232] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:40.551490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.569254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1114/2233] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:40 2022] PUT /identity/v3/projects/8c3f412191554540b29993c83055f2cf/users/be3749791160492db5445551db3540f7/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:40.570614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bd44a-97f3-43c7-967b-74d8137aa64a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.579247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.579530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.579805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.614040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] MFA Rules not processed for user `be3749791160492db5445551db3540f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:40.615323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:40.632267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:40.651490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.652163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.652432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.652777 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] PATH_INFO: `/v3/projects/4fd03d1b5dfc45e2ab9dff64b4a26ea4/users/15c0370941a2458d9595ec138de5d2db/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.671116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd03d1b5dfc45e2ab9dff64b4a26ea4, user_id=15c0370941a2458d9595ec138de5d2db, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.674385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.701383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1115/2234] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:40.704973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.715965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14edc1-5723-4a30-9601-cd548fc8aa0f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.722103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.722738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.723018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.723287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.723913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.725878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.824095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1120/2235] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:40 2022] PUT /identity/v3/projects/4fd03d1b5dfc45e2ab9dff64b4a26ea4/users/15c0370941a2458d9595ec138de5d2db/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:40.828572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.854590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1116/2236] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:40 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:40.860150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.890600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b30b20-93f8-4a6d-8529-7a92d5d1c31c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.922897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065bce-544f-4a0a-8fbb-a6a490d37a60 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.927612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.928242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.928546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.937681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.937681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.937681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.947531 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.948131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.948403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.948665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.949333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.950915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.958206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:40.963886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1121/2237] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:40.970089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:40.978639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6e316-5c10-43d2-8202-ce424f759c6d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:40.983447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd630d07-d528-4303-8cc6-90c02951fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:40.983993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630d07-d528-4303-8cc6-90c02951fc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:40.984275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630d07-d528-4303-8cc6-90c02951fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:40.984551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630d07-d528-4303-8cc6-90c02951fc7c admin admin] PATH_INFO: `/v3/projects/4fd03d1b5dfc45e2ab9dff64b4a26ea4/users/15c0370941a2458d9595ec138de5d2db/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:40.986474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd630d07-d528-4303-8cc6-90c02951fc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd03d1b5dfc45e2ab9dff64b4a26ea4, user_id=15c0370941a2458d9595ec138de5d2db, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:40.989100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd630d07-d528-4303-8cc6-90c02951fc7c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:40.999568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1122/2238] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:40 2022] PUT /identity/v3/projects/4fd03d1b5dfc45e2ab9dff64b4a26ea4/users/15c0370941a2458d9595ec138de5d2db/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:41.009642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.009955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.010234 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.033962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1117/2239] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:40 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:41.038313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:41.047855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] MFA Rules not processed for user `15c0370941a2458d9595ec138de5d2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:41.049461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:41.049922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974bb60-3e2a-4943-8e60-49a757f0ae2d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:41.108576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:41.109262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.109542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.109815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.111892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:41.113542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:41.118792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1123/2240] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:41.126773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1118/2241] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:41.130865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:41.132210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:41.133739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:41.143926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f7ac7-26b8-4a50-909f-ba4070823634 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:41.149114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:41.149789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.150063 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.150330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] PATH_INFO: `/v3/projects/863306257bcc480c857eeccbcfee84b1/users/d83168cfb0c64ec1a7ff032aee78a3c4/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.165834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863306257bcc480c857eeccbcfee84b1, user_id=d83168cfb0c64ec1a7ff032aee78a3c4, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:41.168523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:41.188794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc517e-f693-470c-8f68-6ac367584cf5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:41.192416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:41.193699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.193699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.193699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.195360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:41.252991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:41.254537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:41.255483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1119/2242] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:41 2022] PUT /identity/v3/projects/863306257bcc480c857eeccbcfee84b1/users/d83168cfb0c64ec1a7ff032aee78a3c4/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:41.259467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:41.263758 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1124/2243] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:41.325097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9605-a296-40cb-a21c-64618d7cedb2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:41.330054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda45935-208e-42de-b9d9-6a1f143584e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:41.330735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda45935-208e-42de-b9d9-6a1f143584e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.331088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda45935-208e-42de-b9d9-6a1f143584e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.331658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda45935-208e-42de-b9d9-6a1f143584e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.332378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda45935-208e-42de-b9d9-6a1f143584e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:41.334172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda45935-208e-42de-b9d9-6a1f143584e5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:41.347047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1120/2244] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:41.351546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:41.371849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249008eb-109a-4a33-836d-8feef67ddf1b service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:41.375870 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:41.377365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.377724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.378063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] PATH_INFO: `/v3/projects/863306257bcc480c857eeccbcfee84b1/users/d83168cfb0c64ec1a7ff032aee78a3c4/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.380634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863306257bcc480c857eeccbcfee84b1, user_id=d83168cfb0c64ec1a7ff032aee78a3c4, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:41.385306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:41.399326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1125/2245] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:41 2022] PUT /identity/v3/projects/863306257bcc480c857eeccbcfee84b1/users/d83168cfb0c64ec1a7ff032aee78a3c4/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:41.414881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.415168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.415439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.448048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] MFA Rules not processed for user `d83168cfb0c64ec1a7ff032aee78a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:41.448048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:41.523939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1121/2246] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:41.668950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:41.671108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:41.738691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1561db-3ed8-4ae9-ac2e-b6c0b4c504e1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:41.742529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:41.743296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:41.743670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:41.743949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:41.816769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:41.819542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:41.834874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1126/2247] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:42.361422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:42.706858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:43.374759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:43.384946 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38d91-2029-4c65-b514-de01391dce71 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:43.388539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9418-868e-4301-a881-bf01c65b187f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:43.389139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9418-868e-4301-a881-bf01c65b187f service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:43.389482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9418-868e-4301-a881-bf01c65b187f service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:43.390379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9418-868e-4301-a881-bf01c65b187f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:43.448315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9418-868e-4301-a881-bf01c65b187f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:43.449795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9418-868e-4301-a881-bf01c65b187f service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:43.461026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1122/2248] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:44.379785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:44.385885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:44.464421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f46c-39a1-49d2-bfb1-5312297d6b8c service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:44.470164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:44.470793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:44.471069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:44.471339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] PATH_INFO: `/v3/users/54c8f2d0ee9c449bac92a2b9c66bc0d1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:44.472460 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c8f2d0ee9c449bac92a2b9c66bc0d1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:44.474497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:44.595580 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:44.692193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c8f2d0ee9c449bac92a2b9c66bc0d1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:44.692850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c8f2d0ee9c449bac92a2b9c66bc0d1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:44.693576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c8f2d0ee9c449bac92a2b9c66bc0d1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:44.700835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c8f2d0ee9c449bac92a2b9c66bc0d1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:44.785931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c8f2d0ee9c449bac92a2b9c66bc0d1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:44.814807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1127/2249] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:44 2022] DELETE /identity/v3/users/54c8f2d0ee9c449bac92a2b9c66bc0d1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:44.818752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:44.819230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:44.819325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:44.839543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:44.840748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:44.914337 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1123/2250] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:44.931175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:44.933227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:44.998002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:45.006532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afd09-ddff-4a25-aac7-61e3beb1ee5a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:45.010253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:45.010859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:45.011138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:45.011400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:45.021193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:45.022682 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:45.040026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1128/2251] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:45.250748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:45.253312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:45.323294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd868-36c0-4d7a-9a60-d3e7dd3cb6d7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:45.327045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:45.327805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:45.328128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:45.328383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:45.330484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:45.404760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:45.406874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:45.417487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1124/2252] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:45.450075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:45.451648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:45.465840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd51e-7104-40fc-9481-a016f5fd14a5 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:45.471417 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:45.472039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:45.472325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:45.472595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:45.474447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:45.542206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:45.543882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70a2e6-af6a-4390-af57-6d11efc73b25 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:45.553599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1129/2253] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:45.667724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:45.669987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:45.685824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bcb01-0815-43a3-83ee-bcbe891d1ce3 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:45.691563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:45.692230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:45.692516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:45.692790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] PATH_INFO: `/v3/projects/8734ca5b67a142808b91b1f250822b64` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:45.694808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8734ca5b67a142808b91b1f250822b64)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:45.696802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:45.850029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8734ca5b67a142808b91b1f250822b64', 'request_id': 'req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:45.969352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8734ca5b67a142808b91b1f250822b64', 'request_id': 'req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:45.981002 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8734ca5b67a142808b91b1f250822b64', 'request_id': 'req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:45.988578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] The token cache is being invalidate because project 8734ca5b67a142808b91b1f250822b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:45.988899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:45.989597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ff731ce-fb15-4fe9-aef5-4fcba7e3afb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:45.991189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1125/2254] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:45 2022] DELETE /identity/v3/projects/8734ca5b67a142808b91b1f250822b64 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:45.996151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:45.996435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:45.996713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.017380 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:46.018594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:46.082289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1130/2255] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:46.090120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.090426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.090691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.114933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:46.116247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:46.125301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1126/2256] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:46.129743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.139789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24cc94-eef6-4344-8b0d-bf8368441ab7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.144453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.145051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.145360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.145628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.146292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:46.146589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.148542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.160670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1131/2257] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:47:46.166152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.175964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275628-7f60-413e-9047-aee8416f3f88 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.180513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.181097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.181407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.181677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.182294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.184199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.300257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1127/2258] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:46 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:46.304654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.315709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144e76b-1295-4cd4-b134-8517c245eb65 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.375279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.375799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.376085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.376358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.376991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.378959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.505256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1132/2259] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:46 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:46.510905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.522909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740c81-9a10-4e40-8378-86c62c3c1773 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.530122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.531015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.531375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.531724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.532504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.534355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.547484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1128/2260] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:46.552357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.565683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3164-2db2-4622-b167-793207f936bc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.571764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391d09c-b504-4bda-ae30-0d5093705e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.572458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d09c-b504-4bda-ae30-0d5093705e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.572802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d09c-b504-4bda-ae30-0d5093705e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.573158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d09c-b504-4bda-ae30-0d5093705e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.573918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391d09c-b504-4bda-ae30-0d5093705e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.575585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391d09c-b504-4bda-ae30-0d5093705e3d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.592562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1133/2261] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:46.597100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.607906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391277-8ae0-45ed-afcd-a738a30e1a06 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.612904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.613574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.613853 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.614125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] PATH_INFO: `/v3/projects/67aaefb70ca142b08f1a07c8f59b2026/users/648d34117f8b4687921d17010aa4c6d6/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.636536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67aaefb70ca142b08f1a07c8f59b2026, user_id=648d34117f8b4687921d17010aa4c6d6, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.639317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.763656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1129/2262] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:46 2022] PUT /identity/v3/projects/67aaefb70ca142b08f1a07c8f59b2026/users/648d34117f8b4687921d17010aa4c6d6/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:46.775398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.775720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.775995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.805879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] MFA Rules not processed for user `648d34117f8b4687921d17010aa4c6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:46.807121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:46.876408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1134/2263] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:46.887986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:46.889962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:46.953114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48138cc6-b095-40bb-9c6c-452bc32bf276 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:46.956818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea44086-6039-462a-975a-f0c4f422ce1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:46.957449 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea44086-6039-462a-975a-f0c4f422ce1c service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:46.957728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea44086-6039-462a-975a-f0c4f422ce1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:46.957998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea44086-6039-462a-975a-f0c4f422ce1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:46.963560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:46.966143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea44086-6039-462a-975a-f0c4f422ce1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:46.967597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea44086-6039-462a-975a-f0c4f422ce1c service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:46.976651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1130/2264] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:47.484058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:48.360826 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:48.706773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:50.237799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:50.360493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:51.317337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:51.341921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:51.344774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:51.448569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64ffcb-d012-442a-ac42-3c991e238733 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:51.455066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:51.455866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:51.456269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:51.456639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] PATH_INFO: `/v3/users/9009041d1c4b4a4ca1d13e07f13d8104` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:51.458055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9009041d1c4b4a4ca1d13e07f13d8104)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:51.460154 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:51.637410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9009041d1c4b4a4ca1d13e07f13d8104'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:51.638065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9009041d1c4b4a4ca1d13e07f13d8104'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:51.638669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9009041d1c4b4a4ca1d13e07f13d8104'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:51.646364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9009041d1c4b4a4ca1d13e07f13d8104'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:51.742982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9009041d1c4b4a4ca1d13e07f13d8104'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:51.761783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1135/2265] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:51 2022] DELETE /identity/v3/users/9009041d1c4b4a4ca1d13e07f13d8104 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:51.766900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:51.767427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:51.767427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:51.786719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:51.788008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:51.835582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:51.850567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1131/2266] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:51.864209 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:51.865900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:51.928840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928ad8f-ddcc-4481-8b13-a1c32b6a5e3e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:51.932691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:51.933334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:51.933617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:51.933892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:51.944732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:51.946371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:51.958261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1136/2267] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:52.106592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:52.726357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:52.871113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:52.875164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:52.893982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f461-21b5-4bd3-b924-16342c19da6b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:52.906321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:52.907224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:52.907650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:52.908609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] PATH_INFO: `/v3/projects/083961a33eee4009aa1579832d2fd22d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:52.911668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] RBAC: Authorizing `identity:delete_project(project_id=083961a33eee4009aa1579832d2fd22d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:52.915084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:53.026014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083961a33eee4009aa1579832d2fd22d', 'request_id': 'req-f1025378-a625-49f3-8576-140e7c74469a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.131817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083961a33eee4009aa1579832d2fd22d', 'request_id': 'req-f1025378-a625-49f3-8576-140e7c74469a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.137961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083961a33eee4009aa1579832d2fd22d', 'request_id': 'req-f1025378-a625-49f3-8576-140e7c74469a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.146592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:53.150541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] The token cache is being invalidate because project 083961a33eee4009aa1579832d2fd22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:53.150828 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.151476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f1025378-a625-49f3-8576-140e7c74469a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.153367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1132/2268] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:52 2022] DELETE /identity/v3/projects/083961a33eee4009aa1579832d2fd22d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:53.158980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:53.168660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395748b5-09aa-4006-aa37-2e6574c7ebe5 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:53.228516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:53.229268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:53.229556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:53.229830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] PATH_INFO: `/v3/users/adf8f3aca5b142e49ff042019325b497` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:53.230961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf8f3aca5b142e49ff042019325b497)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:53.233020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:53.357194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:53.357517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:53.357815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:53.377195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] MFA Rules not processed for user `25aa1cfa72db4e789990a0015da397d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:53.378509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:53.435192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1133/2269] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:53.550476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf8f3aca5b142e49ff042019325b497'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.551316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf8f3aca5b142e49ff042019325b497'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.551947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf8f3aca5b142e49ff042019325b497'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.570716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf8f3aca5b142e49ff042019325b497'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.711677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf8f3aca5b142e49ff042019325b497'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:53.732567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1137/2270] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:53 2022] DELETE /identity/v3/users/adf8f3aca5b142e49ff042019325b497 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:54.329015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:54.331411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:54.419822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce93c8-0c99-47bf-9eb6-d1a38fa0d56b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:54.508748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:54.509631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:54.510218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:54.510653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] PATH_INFO: `/v3/projects/ef2f00c612ff457589d8cd81370c5fa5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:54.512221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2f00c612ff457589d8cd81370c5fa5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:54.514990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:54.669424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:54.694547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2f00c612ff457589d8cd81370c5fa5', 'request_id': 'req-815b1794-791d-4746-9995-47e98c2b49d8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:54.802929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2f00c612ff457589d8cd81370c5fa5', 'request_id': 'req-815b1794-791d-4746-9995-47e98c2b49d8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:54.811469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2f00c612ff457589d8cd81370c5fa5', 'request_id': 'req-815b1794-791d-4746-9995-47e98c2b49d8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:54.827455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] The token cache is being invalidate because project ef2f00c612ff457589d8cd81370c5fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:54.830205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:54.830205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:54.831666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1134/2271] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:54 2022] DELETE /identity/v3/projects/ef2f00c612ff457589d8cd81370c5fa5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:54.835726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:54.837366 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:54.851963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54e771-4ac9-46fd-9947-b435d37380af admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:54.916847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:54.917529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:54.917808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:54.918078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] PATH_INFO: `/v3/users/15c0370941a2458d9595ec138de5d2db` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:54.919211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c0370941a2458d9595ec138de5d2db)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:54.922210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:55.234311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c0370941a2458d9595ec138de5d2db'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:55.235216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c0370941a2458d9595ec138de5d2db'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:55.235896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c0370941a2458d9595ec138de5d2db'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:55.243534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c0370941a2458d9595ec138de5d2db'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:55.395082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c0370941a2458d9595ec138de5d2db'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:55.438985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1138/2272] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:54 2022] DELETE /identity/v3/users/15c0370941a2458d9595ec138de5d2db => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:47:55.532447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:55.971647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:55.973722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:55.987311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1794-791d-4746-9995-47e98c2b49d8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:56.050245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:56.050887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:56.051157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:56.051425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] PATH_INFO: `/v3/projects/4fd03d1b5dfc45e2ab9dff64b4a26ea4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:56.052793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd03d1b5dfc45e2ab9dff64b4a26ea4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:56.054892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:56.231789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd03d1b5dfc45e2ab9dff64b4a26ea4', 'request_id': 'req-07a18e38-6889-414c-bc39-7326e3392d65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:56.483871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd03d1b5dfc45e2ab9dff64b4a26ea4', 'request_id': 'req-07a18e38-6889-414c-bc39-7326e3392d65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:56.483871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd03d1b5dfc45e2ab9dff64b4a26ea4', 'request_id': 'req-07a18e38-6889-414c-bc39-7326e3392d65'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:56.483871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] The token cache is being invalidate because project 4fd03d1b5dfc45e2ab9dff64b4a26ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:56.483871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:56.485257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-07a18e38-6889-414c-bc39-7326e3392d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:56.485257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1135/2273] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:55 2022] DELETE /identity/v3/projects/4fd03d1b5dfc45e2ab9dff64b4a26ea4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:56.487029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:56.488522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:56.503259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5396c4-a006-4188-81b0-119493137114 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:56.568699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:56.743129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:56.743129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:56.743129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] PATH_INFO: `/v3/users/3cfbacf7531e45eb818f7a775364c4f9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:56.743129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfbacf7531e45eb818f7a775364c4f9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:56.743129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:57.041694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:57.197677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfbacf7531e45eb818f7a775364c4f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:57.198449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfbacf7531e45eb818f7a775364c4f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:57.199056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfbacf7531e45eb818f7a775364c4f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:57.206420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfbacf7531e45eb818f7a775364c4f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:57.291855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:57.337282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfbacf7531e45eb818f7a775364c4f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:57.381031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1139/2274] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:47:56 2022] DELETE /identity/v3/users/3cfbacf7531e45eb818f7a775364c4f9 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:57.385418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:57.388677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:57.388677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:57.410863 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:57.412357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:57.492757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1136/2275] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:57.504836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:57.506521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:57.568292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786996-7291-40ac-88d0-62d3e9faca0e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:57.572024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd307b2-fc43-4f77-89c3-bcf68a21b1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:57.572599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd307b2-fc43-4f77-89c3-bcf68a21b1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:57.572876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd307b2-fc43-4f77-89c3-bcf68a21b1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:57.573144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd307b2-fc43-4f77-89c3-bcf68a21b1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:57.584135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd307b2-fc43-4f77-89c3-bcf68a21b1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:57.585748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd307b2-fc43-4f77-89c3-bcf68a21b1b8 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:57.596910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1140/2276] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:47:58.115757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:58.117782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:58.131477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395ae45-1bf9-4100-9dff-fe4551d75d86 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:58.136096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:58.136727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:58.137005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:58.137312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] PATH_INFO: `/v3/projects/4eb9693a81f3457087863887c0a4a1ab` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:58.138431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb9693a81f3457087863887c0a4a1ab)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:58.140923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:58.327932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb9693a81f3457087863887c0a4a1ab', 'request_id': 'req-16ebdaf9-98b3-491d-96ca-7dadf1b37208'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:58.440109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb9693a81f3457087863887c0a4a1ab', 'request_id': 'req-16ebdaf9-98b3-491d-96ca-7dadf1b37208'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:58.448192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb9693a81f3457087863887c0a4a1ab', 'request_id': 'req-16ebdaf9-98b3-491d-96ca-7dadf1b37208'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:58.467549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] The token cache is being invalidate because project 4eb9693a81f3457087863887c0a4a1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:47:58.467841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:58.468951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-16ebdaf9-98b3-491d-96ca-7dadf1b37208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:47:58.472006 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1137/2277] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:47:58 2022] DELETE /identity/v3/projects/4eb9693a81f3457087863887c0a4a1ab => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:58.477830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:58.477830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:58.477830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:58.502858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:58.506516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:58.603294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1141/2278] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:47:58.614556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:58.614556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:58.614556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:58.648301 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:58.649559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:58.657742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1138/2279] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:58.662294 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:58.672916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c79e47-14d5-4dd6-be16-685f34f05669 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:58.677635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:58.678236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:58.678516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:58.678807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:58.679449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:47:58.679748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:58.681472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:58.694032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1142/2280] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:47:58.703769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:58.713722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6b0ee-2249-46a4-856e-9b94197f2c01 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:58.720232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:58.721097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:58.721482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:58.721785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:58.722428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:58.724644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:58.850395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1139/2281] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:58 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:58.851434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:58.862486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321da0-19e8-4127-9bb4-d7b96a7b247b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:58.948778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43252a48-832a-484d-a228-464f685af66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:58.949443 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43252a48-832a-484d-a228-464f685af66c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:58.957969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43252a48-832a-484d-a228-464f685af66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:58.958353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43252a48-832a-484d-a228-464f685af66c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:58.959120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43252a48-832a-484d-a228-464f685af66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:58.964169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43252a48-832a-484d-a228-464f685af66c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.080134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.087909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1143/2282] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:58 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:59.092272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00060f64-33ff-4f8e-a8d1-8028c074748c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.098708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.100922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.100922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.100922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.100922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.102599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.118202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43252a48-832a-484d-a228-464f685af66c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.118618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1140/2283] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:47:59.130549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43252a48-832a-484d-a228-464f685af66c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.135787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626f328-1ade-45d4-8afc-1a5a25103e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.136495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f328-1ade-45d4-8afc-1a5a25103e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.136838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f328-1ade-45d4-8afc-1a5a25103e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.137178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f328-1ade-45d4-8afc-1a5a25103e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.137975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f328-1ade-45d4-8afc-1a5a25103e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.140489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f328-1ade-45d4-8afc-1a5a25103e99 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.151687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1144/2284] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:59.156613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.166654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a895-ed45-4caf-8159-31c2d4b026d3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.171840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.172651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.172933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.173201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] PATH_INFO: `/v3/projects/935b86362f9a4bb8bfd0ff086747608f/users/d655b75e0b384fafb2bfee9b7515ccc4/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.188812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935b86362f9a4bb8bfd0ff086747608f, user_id=d655b75e0b384fafb2bfee9b7515ccc4, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.191872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.299659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1141/2285] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:59 2022] PUT /identity/v3/projects/935b86362f9a4bb8bfd0ff086747608f/users/d655b75e0b384fafb2bfee9b7515ccc4/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:47:59.311305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.311782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.312257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.346934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] MFA Rules not processed for user `d655b75e0b384fafb2bfee9b7515ccc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:47:59.348370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:47:59.422468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1145/2286] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:47:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:47:59.426961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.437673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:59.500202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1917-216d-4fad-85c9-8fd7f11c5149 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.505704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.507413 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.507889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.508366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.509414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.511957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.534481 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:47:59.650605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1142/2287] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:47:59 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:47:59.655273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.666190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd573f4-4b30-4e8e-a76b-40f28a6fc9ed None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.730480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.731175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.731692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.731963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.732722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.735185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.872388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1146/2288] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:47:59 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:47:59.878054 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.891984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d1558-22f3-441c-8fa1-fdbb9d0b1fc5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.897748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.898670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.899098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.899940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.901121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.903158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:47:59.919635 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1143/2289] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:47:59.923554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:47:59.935006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9caf2-fabe-4b5b-8783-66a5e2c85247 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:47:59.941381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:47:59.942156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:47:59.942338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:47:59.942622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] PATH_INFO: `/v3/projects/ff4e882dc5264e269b58864a6f632477/users/a49cdb924d0b4ebdaddc9aa4550b7b1b/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:47:59.958765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4e882dc5264e269b58864a6f632477, user_id=a49cdb924d0b4ebdaddc9aa4550b7b1b, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:47:59.961553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:00.050698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1147/2290] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:47:59 2022] PUT /identity/v3/projects/ff4e882dc5264e269b58864a6f632477/users/a49cdb924d0b4ebdaddc9aa4550b7b1b/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:00.051650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:00.068687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76975c-427b-47b5-829e-b3ee7de9b11c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:00.172921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7fea-202c-4611-b7f8-88618c7e0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:00.175070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7fea-202c-4611-b7f8-88618c7e0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:00.176908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7fea-202c-4611-b7f8-88618c7e0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:00.185171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7fea-202c-4611-b7f8-88618c7e0c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:00.187761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7fea-202c-4611-b7f8-88618c7e0c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:00.190646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7fea-202c-4611-b7f8-88618c7e0c6b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:00.203830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1144/2291] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:48:00.208571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:00.220756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d0f9-fdbb-464f-9fd8-3e0f17cae380 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:00.226905 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:00.227567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:00.227993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:00.228266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] PATH_INFO: `/v3/projects/ff4e882dc5264e269b58864a6f632477/users/a49cdb924d0b4ebdaddc9aa4550b7b1b/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:00.230325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4e882dc5264e269b58864a6f632477, user_id=a49cdb924d0b4ebdaddc9aa4550b7b1b, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:00.234478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:00.247820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1148/2292] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:00 2022] PUT /identity/v3/projects/ff4e882dc5264e269b58864a6f632477/users/a49cdb924d0b4ebdaddc9aa4550b7b1b/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:00.258448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e4b9-cb42-491f-a49b-57f25d2f7bca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:00.258734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e4b9-cb42-491f-a49b-57f25d2f7bca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:00.259004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e4b9-cb42-491f-a49b-57f25d2f7bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:00.302595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8333e4b9-cb42-491f-a49b-57f25d2f7bca None None] MFA Rules not processed for user `a49cdb924d0b4ebdaddc9aa4550b7b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:00.303850 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8333e4b9-cb42-491f-a49b-57f25d2f7bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:00.414336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1145/2293] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:00.424767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:00.427218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:00.491159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8846ad-61bc-49bf-b84e-558ad70c3c7c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:00.494965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:00.495564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:00.495840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:00.496105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:00.581807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:00.583680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:00.602764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1149/2294] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:00.612398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:00.612823 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:00.612950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:00.643022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:00.644448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:00.724466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1146/2295] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:48:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:00.737925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:00.739544 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:00.826981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4afed2-6413-4cc7-a1e3-c055ea11805b service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:00.832650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f17fe-7b61-49b8-ac3f-a017b0e8a6a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:00.835363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f17fe-7b61-49b8-ac3f-a017b0e8a6a9 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:00.835363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f17fe-7b61-49b8-ac3f-a017b0e8a6a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:00.835363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f17fe-7b61-49b8-ac3f-a017b0e8a6a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:00.843202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f17fe-7b61-49b8-ac3f-a017b0e8a6a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:00.844898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f17fe-7b61-49b8-ac3f-a017b0e8a6a9 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:00.853687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1150/2296] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:48:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:48:01.735003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:01.803402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:03.267770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:03.269412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:03.360801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973329d9-03ae-4e1e-959d-dfc752c6294a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:03.366103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:03.369707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:03.369707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:03.369707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] PATH_INFO: `/v3/users/be3749791160492db5445551db3540f7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:03.369707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3749791160492db5445551db3540f7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:03.371213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:03.584709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3749791160492db5445551db3540f7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:03.585371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3749791160492db5445551db3540f7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:03.672580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3749791160492db5445551db3540f7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:03.687922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3749791160492db5445551db3540f7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:03.687922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3749791160492db5445551db3540f7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:03.735421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1147/2297] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:03 2022] DELETE /identity/v3/users/be3749791160492db5445551db3540f7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:03.740693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:03.741338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:03.741338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:03.765792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:03.767113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:03.855136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:03.861960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1151/2298] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:03.868371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:03.870309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:03.942935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:03.979434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53a69c-8e00-4d0a-8651-71e315f17c1f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:03.983890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:03.984743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:03.985019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:03.985305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:04.004816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:04.006625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:04.023086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1148/2299] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:04.622352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:04.625360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:04.643410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747c6d4-c5bb-461b-a76d-3bc24f0eb8a1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:04.652243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:04.652243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:04.652243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:04.652243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] PATH_INFO: `/v3/projects/8c3f412191554540b29993c83055f2cf` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:04.652799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3f412191554540b29993c83055f2cf)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:04.653923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:04.838693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3f412191554540b29993c83055f2cf', 'request_id': 'req-36bf2de2-384f-4403-8d20-9ecb78aaecaf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:04.846753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3f412191554540b29993c83055f2cf', 'request_id': 'req-36bf2de2-384f-4403-8d20-9ecb78aaecaf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.051680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3f412191554540b29993c83055f2cf', 'request_id': 'req-36bf2de2-384f-4403-8d20-9ecb78aaecaf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.065353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] The token cache is being invalidate because project 8c3f412191554540b29993c83055f2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:05.065649 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.066518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.068017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1152/2300] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:04 2022] DELETE /identity/v3/projects/8c3f412191554540b29993c83055f2cf => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:05.072297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:05.084700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4fb0-bfbe-4efe-8c84-923f39d0156e service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:05.158545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:05.159343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:05.159729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:05.160097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] PATH_INFO: `/v3/users/d83168cfb0c64ec1a7ff032aee78a3c4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:05.161374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83168cfb0c64ec1a7ff032aee78a3c4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:05.163567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:05.239995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:05.242038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:05.266813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2de2-384f-4403-8d20-9ecb78aaecaf admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:05.273624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:05.274698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:05.275753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:05.276370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] PATH_INFO: `/v3/users/d655b75e0b384fafb2bfee9b7515ccc4` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:05.278566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d655b75e0b384fafb2bfee9b7515ccc4)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:05.280838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:05.461563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83168cfb0c64ec1a7ff032aee78a3c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.462574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83168cfb0c64ec1a7ff032aee78a3c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.562526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd655b75e0b384fafb2bfee9b7515ccc4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.563243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd655b75e0b384fafb2bfee9b7515ccc4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.563999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd655b75e0b384fafb2bfee9b7515ccc4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.572265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd655b75e0b384fafb2bfee9b7515ccc4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.577824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83168cfb0c64ec1a7ff032aee78a3c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.586889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83168cfb0c64ec1a7ff032aee78a3c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.587830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-93d5db3f-489a-440b-beb7-34288ef42adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83168cfb0c64ec1a7ff032aee78a3c4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.630270 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1149/2301] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:05 2022] DELETE /identity/v3/users/d83168cfb0c64ec1a7ff032aee78a3c4 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:05.659886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd655b75e0b384fafb2bfee9b7515ccc4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:05.663232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:05.690692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1153/2302] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:05 2022] DELETE /identity/v3/users/d655b75e0b384fafb2bfee9b7515ccc4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:05.694891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:05.696459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:05.696459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:05.720026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:05.729194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:05.730843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:05.829974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1150/2303] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:05.839696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:05.841263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:05.942469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05c55-4c39-4410-865b-ea941d9008d9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:05.962079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb0a7-0b61-4a83-97ed-1f2b4a4a2834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:05.962793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb0a7-0b61-4a83-97ed-1f2b4a4a2834 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:05.963618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb0a7-0b61-4a83-97ed-1f2b4a4a2834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:05.963618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb0a7-0b61-4a83-97ed-1f2b4a4a2834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:05.993600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fb0a7-0b61-4a83-97ed-1f2b4a4a2834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:05.995321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fb0a7-0b61-4a83-97ed-1f2b4a4a2834 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:06.026614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1154/2304] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:48:06.296739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:06.296739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:06.310406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807a9e-89a7-45e0-a3c1-ed58c966660c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:06.327314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:06.328074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:06.328486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:06.328725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] PATH_INFO: `/v3/projects/863306257bcc480c857eeccbcfee84b1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:06.330868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863306257bcc480c857eeccbcfee84b1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:06.332358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:06.454373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863306257bcc480c857eeccbcfee84b1', 'request_id': 'req-af7f15c8-97a7-4ed1-a886-8e792340b459'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:06.545898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863306257bcc480c857eeccbcfee84b1', 'request_id': 'req-af7f15c8-97a7-4ed1-a886-8e792340b459'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:06.554238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863306257bcc480c857eeccbcfee84b1', 'request_id': 'req-af7f15c8-97a7-4ed1-a886-8e792340b459'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:06.579688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] The token cache is being invalidate because project 863306257bcc480c857eeccbcfee84b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:06.580072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:06.581333 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-af7f15c8-97a7-4ed1-a886-8e792340b459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:06.586897 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1151/2305] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:06 2022] DELETE /identity/v3/projects/863306257bcc480c857eeccbcfee84b1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:06.588021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:06.596463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:06.596463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:06.647458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:06.648841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:06.693746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:06.770909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1155/2306] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:06.781158 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:06.781698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:06.781975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:06.797582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:06.799822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:06.810848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:06.810848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:06.823194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1152/2307] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:06.824484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:06.831911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c35ade-9baf-488b-9d42-a63527444185 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:06.841094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:06.842741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:06.843547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:06.843777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb651-57ac-4f0f-8a3c-569106f9ed50 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:06.843978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] PATH_INFO: `/v3/projects/935b86362f9a4bb8bfd0ff086747608f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:06.846080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935b86362f9a4bb8bfd0ff086747608f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:06.850381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:06.854199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:06.854873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:06.855213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:06.856157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:06.856819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:48:06.857869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:06.860079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:06.878905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1153/2308] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:48:06.883942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:06.901629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86a0e-5c16-459e-a88c-460bb6ec5973 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:06.908905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:06.909552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:06.909832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:06.910101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:06.910729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:06.912784 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:07.017804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935b86362f9a4bb8bfd0ff086747608f', 'request_id': 'req-811af6b0-3e8d-4544-b0db-0c914e1b8d88'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.018443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1154/2309] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:06 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:07.023736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:07.027720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935b86362f9a4bb8bfd0ff086747608f', 'request_id': 'req-811af6b0-3e8d-4544-b0db-0c914e1b8d88'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.110329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62ab63-d6dc-43df-b3e3-efd05822ce0c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:07.115410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:07.116139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:07.117137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:07.117137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:07.117579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:07.119780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:07.137096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935b86362f9a4bb8bfd0ff086747608f', 'request_id': 'req-811af6b0-3e8d-4544-b0db-0c914e1b8d88'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.155274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] The token cache is being invalidate because project 935b86362f9a4bb8bfd0ff086747608f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:07.155999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.156999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.160328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1156/2310] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:06 2022] DELETE /identity/v3/projects/935b86362f9a4bb8bfd0ff086747608f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:07.163976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:07.165789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:07.259717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811af6b0-3e8d-4544-b0db-0c914e1b8d88 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:07.266180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:07.266894 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:07.267244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:07.267588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] PATH_INFO: `/v3/users/a49cdb924d0b4ebdaddc9aa4550b7b1b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:07.268858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49cdb924d0b4ebdaddc9aa4550b7b1b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:07.292433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:07.299131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1155/2311] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:07 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:07.303510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:07.309407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:07.329654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21c8bf-dbd6-4cbb-af13-1583c183de79 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:07.337513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:07.337513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:07.337513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:07.337513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:07.337902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:07.338522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:07.359132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1156/2312] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:48:07.360069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:07.374431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a5d51-7ffe-4eba-910e-ccb9a15015c6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:07.382047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:07.382758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:07.383163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:07.383596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:07.384570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:07.386963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:07.401274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1157/2313] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:07.406372 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:07.418580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1534-381b-44c2-95d8-29494554a3f0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:07.424719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516410f-e8ba-4ddf-aa07-14d152417e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:07.425688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516410f-e8ba-4ddf-aa07-14d152417e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:07.426102 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516410f-e8ba-4ddf-aa07-14d152417e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:07.426384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516410f-e8ba-4ddf-aa07-14d152417e88 admin admin] PATH_INFO: `/v3/projects/4ab37a82202145638fa318d959031381/users/a1f6abb17ffa42e49cdd4e1b22f2fcdf/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:07.450785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516410f-e8ba-4ddf-aa07-14d152417e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab37a82202145638fa318d959031381, user_id=a1f6abb17ffa42e49cdd4e1b22f2fcdf, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:07.458331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516410f-e8ba-4ddf-aa07-14d152417e88 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:07.570304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1158/2314] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:07 2022] PUT /identity/v3/projects/4ab37a82202145638fa318d959031381/users/a1f6abb17ffa42e49cdd4e1b22f2fcdf/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:07.571950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:07.572241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:07.572519 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:07.606448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49cdb924d0b4ebdaddc9aa4550b7b1b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.608676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49cdb924d0b4ebdaddc9aa4550b7b1b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.609547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49cdb924d0b4ebdaddc9aa4550b7b1b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.617568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] MFA Rules not processed for user `a1f6abb17ffa42e49cdd4e1b22f2fcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:07.617568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:07.618384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49cdb924d0b4ebdaddc9aa4550b7b1b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.634117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:07.694468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49cdb924d0b4ebdaddc9aa4550b7b1b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:07.733053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1159/2315] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:07.734458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:07.736044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:07.741343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1157/2316] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:07 2022] DELETE /identity/v3/users/a49cdb924d0b4ebdaddc9aa4550b7b1b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:07.912219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf9420-ad9d-4a8d-a217-dc6063788605 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:08.061734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:08.062887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:08.063334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:08.063770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:08.064587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:08.067061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:08.181586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1160/2317] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:07 2022] POST /identity/v3/projects => generated 391 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:08.186039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:08.225072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1017-7397-4280-b9f1-eb0dbe1cc569 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:08.359603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:08.360226 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:08.361680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:08.409269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:08.409269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:08.409269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:08.912543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:08.914512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:08.927913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252af0f-0439-4c6e-9a19-a201463bd9b5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:08.933046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:08.933855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:08.934229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:08.934617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] PATH_INFO: `/v3/projects/ff4e882dc5264e269b58864a6f632477` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:08.936490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4e882dc5264e269b58864a6f632477)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:08.938792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:08.953617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1158/2318] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:08 2022] POST /identity/v3/users => generated 302 bytes in 764 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:08.954572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:08.965025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4d1fc-7d15-4b26-89f3-180dc87d9fd3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:08.970212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:08.970814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:08.971092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:08.971483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:08.972131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:08.973793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:08.984159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1159/2319] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:48:08.988169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:08.998526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589acee1-663c-4106-b9db-7d252fd9fb1e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.003071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.003686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.003964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.004236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] PATH_INFO: `/v3/projects/80ff226f05764b66805f61a108c0c8ae/users/cdfae61d223b4d53bb28f80880206823/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.020104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ff226f05764b66805f61a108c0c8ae, user_id=cdfae61d223b4d53bb28f80880206823, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.022555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:09.103578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1160/2320] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:08 2022] PUT /identity/v3/projects/80ff226f05764b66805f61a108c0c8ae/users/cdfae61d223b4d53bb28f80880206823/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:09.108246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.127924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4e882dc5264e269b58864a6f632477', 'request_id': 'req-a77f6a30-256b-4101-bc82-82264f1e08f0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:09.186295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e945-0707-4b9f-91dd-0ae10bab052e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.240256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4e882dc5264e269b58864a6f632477', 'request_id': 'req-a77f6a30-256b-4101-bc82-82264f1e08f0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:09.248862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4e882dc5264e269b58864a6f632477', 'request_id': 'req-a77f6a30-256b-4101-bc82-82264f1e08f0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:09.265741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] The token cache is being invalidate because project ff4e882dc5264e269b58864a6f632477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:09.269120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:09.269120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a77f6a30-256b-4101-bc82-82264f1e08f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:09.271904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1161/2321] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:08 2022] DELETE /identity/v3/projects/ff4e882dc5264e269b58864a6f632477 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:09.273325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3c78-acae-40b4-a76d-617372520d12 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.273615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3c78-acae-40b4-a76d-617372520d12 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.273780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.273976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3c78-acae-40b4-a76d-617372520d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.274763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.275119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.275360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.276007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.277820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:09.302965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a83c3c78-acae-40b4-a76d-617372520d12 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:09.304736 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a83c3c78-acae-40b4-a76d-617372520d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:09.308302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1161/2322] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:09.320269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.324799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:09.349845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1162/2323] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:09.356262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e834da-875e-4a9b-963c-e0e8e7022e02 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.361230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.361230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.361230 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.365884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59441-64f6-4157-a514-9d60135811c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.368188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59441-64f6-4157-a514-9d60135811c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.368704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59441-64f6-4157-a514-9d60135811c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.368986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59441-64f6-4157-a514-9d60135811c9 admin admin] PATH_INFO: `/v3/projects/80ff226f05764b66805f61a108c0c8ae/users/cdfae61d223b4d53bb28f80880206823/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.372119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59441-64f6-4157-a514-9d60135811c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ff226f05764b66805f61a108c0c8ae, user_id=cdfae61d223b4d53bb28f80880206823, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.377459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59441-64f6-4157-a514-9d60135811c9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:09.405268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1162/2324] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:09 2022] PUT /identity/v3/projects/80ff226f05764b66805f61a108c0c8ae/users/cdfae61d223b4d53bb28f80880206823/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:09.415617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.415617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.415617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.419913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:09.421417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:09.470814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] MFA Rules not processed for user `cdfae61d223b4d53bb28f80880206823`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:09.472286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:09.523916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1163/2325] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:09.529593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.541400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fdd7-1f8d-4848-af15-65d531f13482 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.550501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.551284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.551679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.553125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.553878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:48:09.558317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.560815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:09.598687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1164/2326] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:48:09.598687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.616157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b24cfd-5dce-4762-a701-100000f6cff6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.622943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.622943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.623219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.623592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.624391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.628342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:09.664608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1163/2327] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:09.679464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.682116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:09.739030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:09.776127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd085253-f04c-477e-abb0-f325fb485c5a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.795207 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.797911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.798384 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.798869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.808797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1165/2328] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:09 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:09.813452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.817790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.820004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:09.833490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1164/2329] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:09.914482 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:09.916468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:09.923648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e701-2e32-482c-9a98-d100583de959 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.929942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6a35-5310-452e-a637-94208e14af56 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:09.930914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:09.938659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:09.938659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:09.938659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:09.938659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:09.938659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:10.006249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:10.006815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:10.007094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:10.007363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:10.009303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:10.048826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1166/2330] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:09 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:10.050473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:10.065553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:10.078625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b60e-20aa-4e5f-a82d-cf5b97e3ebab admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:10.100819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:10.101014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:10.102449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:10.103128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:10.103506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:10.103881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:10.104723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:10.111216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:10.116968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1165/2331] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:48:10.143375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1167/2332] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:10.147646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:10.163187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b37647-47a5-46fa-bb07-0040f39e07d2 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:10.169181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4e54a-d834-4662-8a71-ebcae8522636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:10.170566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4e54a-d834-4662-8a71-ebcae8522636 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:10.170743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4e54a-d834-4662-8a71-ebcae8522636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:10.172229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4e54a-d834-4662-8a71-ebcae8522636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:10.172229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4e54a-d834-4662-8a71-ebcae8522636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:10.173600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4e54a-d834-4662-8a71-ebcae8522636 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:10.188501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1166/2333] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:10.189745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:10.223523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b16ad-4505-4f5a-9138-35b313c5990e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:10.235541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:10.236377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:10.237311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:10.237604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] PATH_INFO: `/v3/projects/d897f781b4014edea6469b54b20b3d64/users/856e2a3dae5a4b87a51eb417c5f471d0/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:10.264970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d897f781b4014edea6469b54b20b3d64, user_id=856e2a3dae5a4b87a51eb417c5f471d0, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:10.266177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:10.402395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1168/2334] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:10 2022] PUT /identity/v3/projects/d897f781b4014edea6469b54b20b3d64/users/856e2a3dae5a4b87a51eb417c5f471d0/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:10.413046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:10.413640 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:10.414105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:10.474376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] MFA Rules not processed for user `856e2a3dae5a4b87a51eb417c5f471d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:10.476000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:10.598190 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1167/2335] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:11.280554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:11.745980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:13.177252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:13.483108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:14.337097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:14.425367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:14.832902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:14.834869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:14.911425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff8143-f9e8-4f5e-af1e-94734b1c0397 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:14.915018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c77ce-7120-404c-bc94-3afec0b91ce1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:14.915766 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c77ce-7120-404c-bc94-3afec0b91ce1 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:14.916040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c77ce-7120-404c-bc94-3afec0b91ce1 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:14.916310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c77ce-7120-404c-bc94-3afec0b91ce1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:14.925968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c77ce-7120-404c-bc94-3afec0b91ce1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:14.935380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c77ce-7120-404c-bc94-3afec0b91ce1 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:14.939253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1169/2336] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:14.985862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:15.337287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:15.431000 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:15.911493 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:15.998939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.342398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.462342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.579877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.694213 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:16.727131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.753928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.762182 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372c4c-bb99-41c8-bead-150ff6056a66 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:16.766972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:16.767603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:16.767877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:16.768143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] PATH_INFO: `/v3/users/a1f6abb17ffa42e49cdd4e1b22f2fcdf` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:16.769277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f6abb17ffa42e49cdd4e1b22f2fcdf)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:16.771251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:16.957803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f6abb17ffa42e49cdd4e1b22f2fcdf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:16.958624 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f6abb17ffa42e49cdd4e1b22f2fcdf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:16.959231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f6abb17ffa42e49cdd4e1b22f2fcdf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:16.965501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:16.968697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f6abb17ffa42e49cdd4e1b22f2fcdf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:17.016416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:17.050764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f6abb17ffa42e49cdd4e1b22f2fcdf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:17.070242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1168/2337] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:16 2022] DELETE /identity/v3/users/a1f6abb17ffa42e49cdd4e1b22f2fcdf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:17.074881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:17.075259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:17.075723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:17.095961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:17.097198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:17.149062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:17.160400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1170/2338] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:17.170921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:17.172376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:17.231085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5b109-6d7c-406d-bb97-7f6dc8201e03 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:17.236046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:17.236691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:17.245349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:17.245349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:17.247861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:17.250115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:17.270545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:17.276292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1169/2339] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:48:17.479603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:17.673589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:17.702615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:17.781804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:17.783458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:17.797197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a1b6e-41c9-464b-9db5-d2656e93e08d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:17.802116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:17.802772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:17.803074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:17.803343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] PATH_INFO: `/v3/projects/4ab37a82202145638fa318d959031381` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:17.804451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab37a82202145638fa318d959031381)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:17.806487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:17.913482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab37a82202145638fa318d959031381', 'request_id': 'req-685a0ea7-8e99-4598-9c39-81d1a3617175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:17.925587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:18.005239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab37a82202145638fa318d959031381', 'request_id': 'req-685a0ea7-8e99-4598-9c39-81d1a3617175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.013291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab37a82202145638fa318d959031381', 'request_id': 'req-685a0ea7-8e99-4598-9c39-81d1a3617175'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.025715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] The token cache is being invalidate because project 4ab37a82202145638fa318d959031381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:18.025998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.026728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.028608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1171/2340] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:17 2022] DELETE /identity/v3/projects/4ab37a82202145638fa318d959031381 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:18.039724 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:18.042210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4db1e-0df8-42a5-bb91-83b2f2395fdf service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:18.102878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:18.103508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:18.103788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:18.104059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] PATH_INFO: `/v3/users/cdfae61d223b4d53bb28f80880206823` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:18.105172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfae61d223b4d53bb28f80880206823)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:18.107171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:18.111434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:18.171625 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:18.299426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfae61d223b4d53bb28f80880206823'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.299426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfae61d223b4d53bb28f80880206823'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.299935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfae61d223b4d53bb28f80880206823'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.306998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfae61d223b4d53bb28f80880206823'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.393985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f0c89be3-6b48-45fe-b937-4d4a9b9909bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfae61d223b4d53bb28f80880206823'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:18.412426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1170/2341] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:18 2022] DELETE /identity/v3/users/cdfae61d223b4d53bb28f80880206823 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:18.562723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:18.648785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:18.960050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:18.961464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:18.977695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0ea7-8e99-4598-9c39-81d1a3617175 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.042467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.043152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.043363 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.043665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] PATH_INFO: `/v3/projects/80ff226f05764b66805f61a108c0c8ae` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.045928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ff226f05764b66805f61a108c0c8ae)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.048414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:19.214575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ff226f05764b66805f61a108c0c8ae', 'request_id': 'req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:19.234128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:19.299056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ff226f05764b66805f61a108c0c8ae', 'request_id': 'req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:19.305400 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ff226f05764b66805f61a108c0c8ae', 'request_id': 'req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:19.316313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] The token cache is being invalidate because project 80ff226f05764b66805f61a108c0c8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:19.316598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:19.317241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5de2f0c1-9170-492c-ad9a-9fd8cabd7e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:19.318739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1172/2342] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:18 2022] DELETE /identity/v3/projects/80ff226f05764b66805f61a108c0c8ae => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:19.323603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.323937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.324233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.346974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:19.351648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:19.371370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:19.415965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1171/2343] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:19.424902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.425191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.425593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.448516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:19.449769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:19.458399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1173/2344] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:19.462641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:19.485359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7626-0215-42db-8334-7a15c05ce1f6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.496405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.497042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.497454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.497804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.498451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:48:19.498750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.500350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:19.514189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1172/2345] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:48:19.518541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:19.525193 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:19.527856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d46a7-aa10-4d11-b2c3-8b6916ce0b60 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.533319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.534012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.534195 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.534436 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.535076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.536991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:19.647282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1174/2346] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:19 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:19.651543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:19.661993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eee4e-5e80-41c3-b4b9-c31ea89bc82f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.722789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.724898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.725188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.725491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.726169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.728089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:19.748692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:19.841600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1173/2347] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:19 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:19.846227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:19.861658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417e9e-bcc8-406e-9a22-e3d1289f241e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.867256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.867891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.868167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.868433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.869567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.870781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:19.881224 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1175/2348] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:19.885808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:19.897361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a4e2-c701-43b0-b341-cfc8986da48e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.906184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d3860-d175-4b8b-a32e-4b37677a401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.906184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3860-d175-4b8b-a32e-4b37677a401e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.906184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3860-d175-4b8b-a32e-4b37677a401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.906184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3860-d175-4b8b-a32e-4b37677a401e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.906697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d3860-d175-4b8b-a32e-4b37677a401e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.907255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d3860-d175-4b8b-a32e-4b37677a401e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:19.921856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1174/2349] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:19.932978 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:19.952404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4bf8b-2261-468a-a905-d3b789f91092 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:19.957940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:19.958610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:19.959033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:19.959139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] PATH_INFO: `/v3/projects/b09c32e6a31946d58dbd9ab5831d059d/users/3dd0c838729c41098e3be9fbf9a51b97/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:19.974765 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09c32e6a31946d58dbd9ab5831d059d, user_id=3dd0c838729c41098e3be9fbf9a51b97, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:19.977453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:20.019510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:20.165542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1176/2350] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:19 2022] PUT /identity/v3/projects/b09c32e6a31946d58dbd9ab5831d059d/users/3dd0c838729c41098e3be9fbf9a51b97/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:20.177446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.177728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.177997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.196366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:20.218478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] MFA Rules not processed for user `3dd0c838729c41098e3be9fbf9a51b97`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:20.218478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:20.280716 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1175/2351] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:20.285104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:20.349391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cac48c-dba1-4c2e-87b7-020c50e88625 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:20.354030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:20.354629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.354905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.355206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.355841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:20.358316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:20.458027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1177/2352] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:20 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:20.462151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:20.474245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc959ae-15b8-4d90-b899-562b65b9bf86 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:20.532428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:20.533035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.533347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.533620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.534246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:20.536346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:20.539704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:20.640769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1176/2353] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:20 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:20.644239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:20.655275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbe0e5-7da5-47af-a5c0-9ad6a4c6c84d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:20.660078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:20.660698 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.660976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.661274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.662075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:20.663921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:20.676086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1178/2354] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:20.680340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:20.691087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa6e2e-3ef8-4fa5-8a4d-0b67cdaf44e9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:20.695518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad580c79-1069-470f-8929-838e45eefe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:20.696119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad580c79-1069-470f-8929-838e45eefe55 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.696400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad580c79-1069-470f-8929-838e45eefe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.696673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad580c79-1069-470f-8929-838e45eefe55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.697349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad580c79-1069-470f-8929-838e45eefe55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:20.698990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad580c79-1069-470f-8929-838e45eefe55 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:20.709189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1177/2355] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:48:20.713583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:20.724741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cf973-3f85-41aa-9036-c615b5c8cde2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:20.729323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:20.729984 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.730262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.730533 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] PATH_INFO: `/v3/projects/f65374cd37214805a2050edff26c09ff/users/367917474dfc4850bfb2417f1b617cc6/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.745458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65374cd37214805a2050edff26c09ff, user_id=367917474dfc4850bfb2417f1b617cc6, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:20.748661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:20.845916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1179/2356] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:20 2022] PUT /identity/v3/projects/f65374cd37214805a2050edff26c09ff/users/367917474dfc4850bfb2417f1b617cc6/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:20.857301 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:20.857583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:20.857850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:20.889060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] MFA Rules not processed for user `367917474dfc4850bfb2417f1b617cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:20.890415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:20.957198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1178/2357] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:20.960166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.036039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0595ea6-26a1-4513-941b-5cd3432a5276 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.040592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.041184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.041497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.041768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.042388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.044340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.059835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:21.205010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1180/2358] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:20 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:21.209250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.220613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2dbd9-d54d-4b5e-8563-50c7b0b628bf None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.280616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.281243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.282145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.282145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.282448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.284760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.392204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1179/2359] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:21 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:48:21.395919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.408020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe60b20-0a8c-4ebe-aa1d-99bf6adc2af6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.415914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.415914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.415914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.415914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.416296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.416296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.427257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1181/2360] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:21.431499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.442386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a9bd-02e5-4e75-9308-ba868907948c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.447175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.447809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.448085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.448352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] PATH_INFO: `/v3/projects/58afbd2e300b4b5594c7eaff9f8ab9be/users/b513f4fe01404e449b7128b2e8fa3058/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.463613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58afbd2e300b4b5594c7eaff9f8ab9be, user_id=b513f4fe01404e449b7128b2e8fa3058, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.466456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.499731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:21.552406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1180/2361] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:21 2022] PUT /identity/v3/projects/58afbd2e300b4b5594c7eaff9f8ab9be/users/b513f4fe01404e449b7128b2e8fa3058/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:21.556812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:21.558294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.571871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947104-fade-40f0-9bc2-ef51a8c1f81d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.635120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d48d-95fe-490c-ada8-52b8fb7169d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.635716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d48d-95fe-490c-ada8-52b8fb7169d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.635989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d48d-95fe-490c-ada8-52b8fb7169d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.636254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d48d-95fe-490c-ada8-52b8fb7169d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.636886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618d48d-95fe-490c-ada8-52b8fb7169d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.638515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618d48d-95fe-490c-ada8-52b8fb7169d1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.648606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1182/2362] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:21.652692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.663247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af38eb-e778-4976-930f-21c079baa347 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.667943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d41f1-df0f-40e1-8266-565b4e0dfb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.669166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d41f1-df0f-40e1-8266-565b4e0dfb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.669456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d41f1-df0f-40e1-8266-565b4e0dfb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.669939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d41f1-df0f-40e1-8266-565b4e0dfb2e admin admin] PATH_INFO: `/v3/projects/58afbd2e300b4b5594c7eaff9f8ab9be/users/b513f4fe01404e449b7128b2e8fa3058/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.672128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d41f1-df0f-40e1-8266-565b4e0dfb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58afbd2e300b4b5594c7eaff9f8ab9be, user_id=b513f4fe01404e449b7128b2e8fa3058, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.675005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d41f1-df0f-40e1-8266-565b4e0dfb2e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.687784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1181/2363] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:21 2022] PUT /identity/v3/projects/58afbd2e300b4b5594c7eaff9f8ab9be/users/b513f4fe01404e449b7128b2e8fa3058/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:21.688364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201f5d-b6e7-40ad-a139-b27ee7cd67c6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.688684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201f5d-b6e7-40ad-a139-b27ee7cd67c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.688993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201f5d-b6e7-40ad-a139-b27ee7cd67c6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.693426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:21.695281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1183/2364] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:48:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:48:21.696271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.696739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.696977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.698275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.698672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.699004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.731484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:21.734458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:21.738758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] MFA Rules not processed for user `b513f4fe01404e449b7128b2e8fa3058`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:21.740944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:21.806959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1182/2365] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:48:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:21.823387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1184/2366] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:21.835110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:21.836527 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:21.895137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6cea-a975-490c-ac0d-7b7a2ea42c18 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:21.900099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:21.900673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:21.900956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:21.901246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:21.922093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:21.963447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:21.964944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:21.974454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1183/2367] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:22.053987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:22.111130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:22.382402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:22.462180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:22.785472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:22.839949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:23.339434 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:23.425578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:23.665237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:24.134660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:24.136088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:24.148974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64aea-b97e-4f8b-8096-23a6a7799c38 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:24.154497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654db121-8182-4ae4-b715-78e169fa92ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:24.155527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db121-8182-4ae4-b715-78e169fa92ff service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:24.156004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db121-8182-4ae4-b715-78e169fa92ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:24.156460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654db121-8182-4ae4-b715-78e169fa92ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:24.216961 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db121-8182-4ae4-b715-78e169fa92ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:24.219121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654db121-8182-4ae4-b715-78e169fa92ff service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:24.224950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:24.229771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1185/2368] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:25.063955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:25.065408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:25.096291 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:25.128806 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22737-1153-4e3b-9e01-71b9b38af623 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:25.132505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bffe5-e7ab-4878-afe3-3d0c320881b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:25.133102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bffe5-e7ab-4878-afe3-3d0c320881b7 service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.133409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bffe5-e7ab-4878-afe3-3d0c320881b7 service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.133678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bffe5-e7ab-4878-afe3-3d0c320881b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.144249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bffe5-e7ab-4878-afe3-3d0c320881b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:25.145713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bffe5-e7ab-4878-afe3-3d0c320881b7 service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:25.156541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1184/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:25.219526 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:25.463335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bdb04-da55-4042-ae31-30bf42de028f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.463686 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bdb04-da55-4042-ae31-30bf42de028f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.463964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bdb04-da55-4042-ae31-30bf42de028f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.465458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1186/2370] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:48:25.470734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9940b7-103d-4f7b-865c-a084506f7de0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.470948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9940b7-103d-4f7b-865c-a084506f7de0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.471241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9940b7-103d-4f7b-865c-a084506f7de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.491504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2e9940b7-103d-4f7b-865c-a084506f7de0 None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:25.497513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2e9940b7-103d-4f7b-865c-a084506f7de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:25.554627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1185/2371] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:25.567472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bdb04-da55-4042-ae31-30bf42de028f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:25.569289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e32bdb04-da55-4042-ae31-30bf42de028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:25.582573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bdb04-da55-4042-ae31-30bf42de028f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:25.586133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70465c2-ece0-4072-9f0b-454431a16765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:25.586754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70465c2-ece0-4072-9f0b-454431a16765 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.587033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70465c2-ece0-4072-9f0b-454431a16765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.587303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70465c2-ece0-4072-9f0b-454431a16765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.594834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70465c2-ece0-4072-9f0b-454431a16765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:25.596287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70465c2-ece0-4072-9f0b-454431a16765 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:25.604168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1187/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:25.688857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452b6ab-80ef-42ad-a716-be3874c25a03 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.689142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452b6ab-80ef-42ad-a716-be3874c25a03 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.689479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452b6ab-80ef-42ad-a716-be3874c25a03 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.690880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1186/2373] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:48:25.696412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.696701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.696979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.717188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:25.718713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:25.728190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1188/2374] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:25.739306 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452b6ab-80ef-42ad-a716-be3874c25a03 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:25.750876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452b6ab-80ef-42ad-a716-be3874c25a03 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:25.754927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8aa316-4a96-4e8a-88a8-3bff47d4046a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:25.755526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aa316-4a96-4e8a-88a8-3bff47d4046a service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:25.755802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aa316-4a96-4e8a-88a8-3bff47d4046a service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:25.756117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aa316-4a96-4e8a-88a8-3bff47d4046a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:25.767860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8aa316-4a96-4e8a-88a8-3bff47d4046a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:25.769348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8aa316-4a96-4e8a-88a8-3bff47d4046a service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:25.783625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1187/2375] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:26.013414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:26.125080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:26.207415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:26.218202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23738828-4374-4f9b-a0d0-864dccc482ad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:26.221709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:26.222320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:26.222575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:26.222817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:26.232773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:26.234192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:26.243666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1189/2376] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:26.688013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:27.182331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:27.468373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:27.505100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:27.691617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:27.734259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.082387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.162323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.485028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.542078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.713342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.759231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.807715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.830587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.876567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:28.951215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:29.179031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:29.485556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:29.852146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:29.852582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:29.852723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:29.873637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:29.874858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:29.935882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1188/2377] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:48:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:29.959065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:29.960672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:30.004929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:30.034260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d72d-33a3-48eb-b8b6-6a445d90c7b7 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:30.039952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c25df-4c19-4dc5-9290-392054eab0d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:30.040559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c25df-4c19-4dc5-9290-392054eab0d4 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:30.040833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c25df-4c19-4dc5-9290-392054eab0d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:30.041099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c25df-4c19-4dc5-9290-392054eab0d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:30.058440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c25df-4c19-4dc5-9290-392054eab0d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:30.060385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c25df-4c19-4dc5-9290-392054eab0d4 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:30.070444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1190/2378] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:48:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:48:30.225751 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:30.451553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:30.860653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:30.952795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:31.154370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:31.185451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:31.245186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:31.264435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416e1d0-1705-475a-90fd-e5c04e2d3084 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:31.269369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:31.270511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:31.270656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:31.271041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] PATH_INFO: `/v3/users/3dd0c838729c41098e3be9fbf9a51b97` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:31.273008 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd0c838729c41098e3be9fbf9a51b97)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:31.278371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:31.499469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:31.533808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:31.542117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd0c838729c41098e3be9fbf9a51b97'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:31.542772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd0c838729c41098e3be9fbf9a51b97'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:31.543448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd0c838729c41098e3be9fbf9a51b97'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:31.550718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd0c838729c41098e3be9fbf9a51b97'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:31.660460 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd0c838729c41098e3be9fbf9a51b97'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:31.686819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1189/2379] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:31 2022] DELETE /identity/v3/users/3dd0c838729c41098e3be9fbf9a51b97 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:31.692239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:31.692804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:31.693345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:31.723146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:31.725122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:31.737422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:31.861411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1191/2380] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:31.873676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:31.874753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:31.977014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51fec0-c09d-4070-9219-861717b04f60 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:31.983610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:31.985465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:31.986078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:31.986464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:32.001687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:32.015437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:32.038263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1190/2381] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:33.001311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:33.003643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:33.018173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667abfd4-47d8-48ff-8d5f-6b4c57389a7e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:33.024199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:33.025103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:33.025578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:33.041359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] PATH_INFO: `/v3/projects/b09c32e6a31946d58dbd9ab5831d059d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:33.048690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09c32e6a31946d58dbd9ab5831d059d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:33.050892 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:33.238121 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09c32e6a31946d58dbd9ab5831d059d', 'request_id': 'req-24249536-621c-4b21-8507-86fbf0ec3fa1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.327255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09c32e6a31946d58dbd9ab5831d059d', 'request_id': 'req-24249536-621c-4b21-8507-86fbf0ec3fa1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.334582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09c32e6a31946d58dbd9ab5831d059d', 'request_id': 'req-24249536-621c-4b21-8507-86fbf0ec3fa1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.351182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] The token cache is being invalidate because project b09c32e6a31946d58dbd9ab5831d059d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:33.351503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.352148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.353882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1192/2382] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:33 2022] DELETE /identity/v3/projects/b09c32e6a31946d58dbd9ab5831d059d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:33.360658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:33.371916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968071c-97bd-489e-abce-036f6a1d320c service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:33.436820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:33.437853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:33.438339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:33.438789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] PATH_INFO: `/v3/users/367917474dfc4850bfb2417f1b617cc6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:33.440175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367917474dfc4850bfb2417f1b617cc6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:33.442632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:33.874977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367917474dfc4850bfb2417f1b617cc6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.900604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367917474dfc4850bfb2417f1b617cc6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.900604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367917474dfc4850bfb2417f1b617cc6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.900604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367917474dfc4850bfb2417f1b617cc6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:33.900604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:34.322189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367917474dfc4850bfb2417f1b617cc6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:34.343338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1191/2383] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:33 2022] DELETE /identity/v3/users/367917474dfc4850bfb2417f1b617cc6 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:35.171877 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:35.173424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:35.191143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249536-621c-4b21-8507-86fbf0ec3fa1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:35.253059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:35.253742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:35.254018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:35.254349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] PATH_INFO: `/v3/projects/f65374cd37214805a2050edff26c09ff` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:35.255667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65374cd37214805a2050edff26c09ff)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:35.258073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:35.718094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:35.736351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65374cd37214805a2050edff26c09ff', 'request_id': 'req-ec859327-1b28-4ecb-bd05-2b86f532fa5a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:35.908537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65374cd37214805a2050edff26c09ff', 'request_id': 'req-ec859327-1b28-4ecb-bd05-2b86f532fa5a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:35.917191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65374cd37214805a2050edff26c09ff', 'request_id': 'req-ec859327-1b28-4ecb-bd05-2b86f532fa5a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:35.935081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] The token cache is being invalidate because project f65374cd37214805a2050edff26c09ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:35.940651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:35.940651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:35.940651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1193/2384] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:35 2022] DELETE /identity/v3/projects/f65374cd37214805a2050edff26c09ff => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:35.942586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:35.944236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:35.958402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1f37-a1d0-482a-bcb8-f3b69478e2e0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:36.017125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:36.018065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:36.018341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:36.018706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] PATH_INFO: `/v3/users/b513f4fe01404e449b7128b2e8fa3058` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:36.019841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b513f4fe01404e449b7128b2e8fa3058)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:36.021768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:36.329586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b513f4fe01404e449b7128b2e8fa3058'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:36.333612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b513f4fe01404e449b7128b2e8fa3058'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:36.334318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b513f4fe01404e449b7128b2e8fa3058'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:36.342298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b513f4fe01404e449b7128b2e8fa3058'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:36.472969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b513f4fe01404e449b7128b2e8fa3058'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:36.494133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1192/2385] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:35 2022] DELETE /identity/v3/users/b513f4fe01404e449b7128b2e8fa3058 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:36.956348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:36.967043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:36.978950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec859327-1b28-4ecb-bd05-2b86f532fa5a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:37.041536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:37.042171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:37.042448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:37.042886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] PATH_INFO: `/v3/projects/58afbd2e300b4b5594c7eaff9f8ab9be` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:37.044197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=58afbd2e300b4b5594c7eaff9f8ab9be)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:37.046295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:37.228303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:37.229788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:37.243346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ab39c-9eab-4704-bb97-f169aca2d33a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:37.249582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:37.250206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:37.250480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:37.250755 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] PATH_INFO: `/v3/users/648d34117f8b4687921d17010aa4c6d6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:37.251903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] RBAC: Authorizing `identity:delete_user(user_id=648d34117f8b4687921d17010aa4c6d6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:37.253926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:37.260565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58afbd2e300b4b5594c7eaff9f8ab9be', 'request_id': 'req-038f9968-997b-494a-b04d-0d5aa19112fe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:37.941935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58afbd2e300b4b5594c7eaff9f8ab9be', 'request_id': 'req-038f9968-997b-494a-b04d-0d5aa19112fe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:37.948660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58afbd2e300b4b5594c7eaff9f8ab9be', 'request_id': 'req-038f9968-997b-494a-b04d-0d5aa19112fe'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:37.960725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] The token cache is being invalidate because project 58afbd2e300b4b5594c7eaff9f8ab9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:37.961452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:37.961717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-038f9968-997b-494a-b04d-0d5aa19112fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:37.963320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1194/2386] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:36 2022] DELETE /identity/v3/projects/58afbd2e300b4b5594c7eaff9f8ab9be => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:37.969185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697514-bc27-4f3e-bcd2-799b4505493a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:37.969502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697514-bc27-4f3e-bcd2-799b4505493a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:37.969778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697514-bc27-4f3e-bcd2-799b4505493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:37.994024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1b697514-bc27-4f3e-bcd2-799b4505493a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:37.995244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b697514-bc27-4f3e-bcd2-799b4505493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:38.053836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:38.065839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1195/2387] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:38.073803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.074750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.075028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.091587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648d34117f8b4687921d17010aa4c6d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:38.092899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648d34117f8b4687921d17010aa4c6d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:38.093940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648d34117f8b4687921d17010aa4c6d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:38.096953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:38.099096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=20,keystone:SELECT=79,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:38.105564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648d34117f8b4687921d17010aa4c6d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:38.114568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:38.128663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1196/2388] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:38.132560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.143030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f3b36-57c3-4c92-a4ac-5948d5eb64e0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.147982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.148593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.148833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.149108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.149790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:48:38.150116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.151754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.164867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1197/2389] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:48:38.169264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.179056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a28c-e382-4f99-a6b4-8bde0759cbf0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.184022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.184613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.184887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.185152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.185917 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.188140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.192828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-680a5049-0330-4369-868e-76db43f9febe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648d34117f8b4687921d17010aa4c6d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:38.212735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1193/2390] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:37 2022] DELETE /identity/v3/users/648d34117f8b4687921d17010aa4c6d6 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:38.218092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.218458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.218739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.238509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:38.239937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:38.295165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1198/2391] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:38 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:48:38.299269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.321509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1194/2392] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:48:38.331679 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.333261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:38.426220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8124e5-0eb0-4f56-9808-5d9d77b4be4d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.450904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c71a-7d5d-48f5-97b2-90e302e02644 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.458417 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.459132 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.459378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.459674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.460307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.462890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.490986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.491740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.492092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.492473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.504075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.505914 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.517110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1195/2393] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:48:38.591649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1199/2394] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:38 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:38.596050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.617061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9933-e0e4-4b71-892d-570261c1aa26 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.632337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.633167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.633485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.633759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.634524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.636099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.649261 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1196/2395] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:38.652813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.662279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85060682-d6fe-4890-bcbc-fc3dc297b5b7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.667691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fd7ae-8787-4142-af35-15fadd30f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.668911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fd7ae-8787-4142-af35-15fadd30f0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.669208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fd7ae-8787-4142-af35-15fadd30f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.669543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fd7ae-8787-4142-af35-15fadd30f0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.670343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fd7ae-8787-4142-af35-15fadd30f0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.672190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fd7ae-8787-4142-af35-15fadd30f0e8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.688979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1200/2396] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:38.689611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:38.707123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9163b-ea12-4ed8-b415-5d391499a26b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:38.726587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:38.727364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.727526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.727809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] PATH_INFO: `/v3/projects/fd7f4fc6b9c34f2a81204baf44066353/users/0cd53e0265824f54839c856591e85b77/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.743918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:38.748363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7f4fc6b9c34f2a81204baf44066353, user_id=0cd53e0265824f54839c856591e85b77, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:38.751348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:38.854415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1197/2397] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:38 2022] PUT /identity/v3/projects/fd7f4fc6b9c34f2a81204baf44066353/users/0cd53e0265824f54839c856591e85b77/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:38.859249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:38.859571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:38.859851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:38.880032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:38.881419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:38.953685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1201/2398] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:38.960694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:39.008855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:39.010322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:39.024971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc709-9f48-4ee5-bd46-17ead138c0bd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:39.031890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e972-d8ca-4cc3-a5ec-392c92541a13 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:39.033191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552b9f4-fb32-4dd5-8e69-cbdf1b66ab4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:39.033908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b9f4-fb32-4dd5-8e69-cbdf1b66ab4f service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:39.034186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b9f4-fb32-4dd5-8e69-cbdf1b66ab4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:39.034988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b9f4-fb32-4dd5-8e69-cbdf1b66ab4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:39.041223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:39.041898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:39.042174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:39.042442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] PATH_INFO: `/v3/projects/67aaefb70ca142b08f1a07c8f59b2026` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:39.046183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67aaefb70ca142b08f1a07c8f59b2026)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:39.048068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:39.057058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552b9f4-fb32-4dd5-8e69-cbdf1b66ab4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:39.058574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552b9f4-fb32-4dd5-8e69-cbdf1b66ab4f service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:39.069848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1198/2399] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:48:39.213994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:39.231559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67aaefb70ca142b08f1a07c8f59b2026', 'request_id': 'req-20769605-2ebc-4a64-8cf2-156992bf56a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:39.349903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67aaefb70ca142b08f1a07c8f59b2026', 'request_id': 'req-20769605-2ebc-4a64-8cf2-156992bf56a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:39.357938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67aaefb70ca142b08f1a07c8f59b2026', 'request_id': 'req-20769605-2ebc-4a64-8cf2-156992bf56a3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:39.378269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] The token cache is being invalidate because project 67aaefb70ca142b08f1a07c8f59b2026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:39.378558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:39.380159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:39.393252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1202/2400] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:39 2022] DELETE /identity/v3/projects/67aaefb70ca142b08f1a07c8f59b2026 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:48:40.637398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436eba7-8c3e-4f5d-ab09-799f55bbad2e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:40.637935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436eba7-8c3e-4f5d-ab09-799f55bbad2e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:40.637935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436eba7-8c3e-4f5d-ab09-799f55bbad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:40.667533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7436eba7-8c3e-4f5d-ab09-799f55bbad2e None None] MFA Rules not processed for user `0cd53e0265824f54839c856591e85b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:40.669565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7436eba7-8c3e-4f5d-ab09-799f55bbad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:40.738347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1199/2401] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:40.749795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:40.751204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:40.810994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20769605-2ebc-4a64-8cf2-156992bf56a3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:40.815508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0c61-3943-4cfd-a28a-d531a4cc33d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:40.816204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0c61-3943-4cfd-a28a-d531a4cc33d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:40.816549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0c61-3943-4cfd-a28a-d531a4cc33d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:40.816925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0c61-3943-4cfd-a28a-d531a4cc33d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:40.826079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0c61-3943-4cfd-a28a-d531a4cc33d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:40.827622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0c61-3943-4cfd-a28a-d531a4cc33d8 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:40.837174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1203/2402] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:42.621635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:42.622346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:42.622346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:42.641817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] MFA Rules not processed for user `0cd53e0265824f54839c856591e85b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:42.643010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:42.649857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1200/2403] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:48.881093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601255c-9376-42d6-a234-742a4c72acef None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:48.881749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601255c-9376-42d6-a234-742a4c72acef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:48.881749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601255c-9376-42d6-a234-742a4c72acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:48.936817 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6601255c-9376-42d6-a234-742a4c72acef None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:48.938116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6601255c-9376-42d6-a234-742a4c72acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:49.044628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1204/2404] 10.222.0.64 () {58 vars in 967 bytes} [Fri Sep 9 11:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:49.062444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:49.063916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:49.157507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f500f-6bc5-4243-b2ec-3310257be83b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:49.164048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e6202-e19a-4b32-bb42-a4c29e1222ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:49.164970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6202-e19a-4b32-bb42-a4c29e1222ae service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:49.165442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6202-e19a-4b32-bb42-a4c29e1222ae service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:49.165900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e6202-e19a-4b32-bb42-a4c29e1222ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:49.176879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e6202-e19a-4b32-bb42-a4c29e1222ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:49.178546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e6202-e19a-4b32-bb42-a4c29e1222ae service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:49.190241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1201/2405] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:48:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:48:51.354245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601255c-9376-42d6-a234-742a4c72acef None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:51.356145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6601255c-9376-42d6-a234-742a4c72acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:51.434044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601255c-9376-42d6-a234-742a4c72acef None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:51.438822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:51.439466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:51.439745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:51.440017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] PATH_INFO: `/v3/users/856e2a3dae5a4b87a51eb417c5f471d0` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:51.441162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856e2a3dae5a4b87a51eb417c5f471d0)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:51.443118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:51.450218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:51.657202 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856e2a3dae5a4b87a51eb417c5f471d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:51.658761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856e2a3dae5a4b87a51eb417c5f471d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:51.749318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856e2a3dae5a4b87a51eb417c5f471d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:51.757835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856e2a3dae5a4b87a51eb417c5f471d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:51.758543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856e2a3dae5a4b87a51eb417c5f471d0'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:51.778797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1205/2406] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:48:51 2022] DELETE /identity/v3/users/856e2a3dae5a4b87a51eb417c5f471d0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:51.783269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:51.783782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:51.783875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:51.798364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:51.805031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:51.806316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:51.870902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1202/2407] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:51.881689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:51.883927 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:51.947207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc839c5-7731-4e4e-aea0-33aa4070f5f8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:51.951044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68863afc-e0c1-4457-bc27-732e2641e98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:51.951639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863afc-e0c1-4457-bc27-732e2641e98a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:51.951911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863afc-e0c1-4457-bc27-732e2641e98a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:51.952176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863afc-e0c1-4457-bc27-732e2641e98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:51.962437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863afc-e0c1-4457-bc27-732e2641e98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:51.963966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863afc-e0c1-4457-bc27-732e2641e98a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:51.974696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1206/2408] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:52.480237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:52.480237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:52.480501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e3bc-51e0-46e8-ab97-b7bda2a33ee1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:52.485142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:52.485816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:52.486099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:52.486371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] PATH_INFO: `/v3/projects/d897f781b4014edea6469b54b20b3d64` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:52.487627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d897f781b4014edea6469b54b20b3d64)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:52.489586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:52.617446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd897f781b4014edea6469b54b20b3d64', 'request_id': 'req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:52.624288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd897f781b4014edea6469b54b20b3d64', 'request_id': 'req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:52.709509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd897f781b4014edea6469b54b20b3d64', 'request_id': 'req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:52.723426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] The token cache is being invalidate because project d897f781b4014edea6469b54b20b3d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:48:52.723741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:52.724427 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7876771c-1a1e-44dc-bc70-5a1ac34f2ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:48:52.725973 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1203/2409] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:48:52 2022] DELETE /identity/v3/projects/d897f781b4014edea6469b54b20b3d64 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:52.732237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:52.732761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:52.733205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:52.755714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:52.757253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:52.828316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1207/2410] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:52.839068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:52.839560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:52.839659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:52.861546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:52.863305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:52.873888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1204/2411] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:52.878049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:52.887740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5c7f1-fe33-459a-86ac-e5d9457e0635 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:52.892215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:52.892798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:52.893071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:52.893374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:52.894003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:48:52.894297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:52.895895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:52.909700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1208/2412] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:48:52.914486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:52.925135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf34fd5-e7cb-4576-852c-379466a33512 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:52.930227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:52.930911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:52.931281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:52.931651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:52.932388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:52.935535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:53.027876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1205/2413] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:48:52 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:53.031993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:53.042954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf044ba0-7743-4fd9-a548-19e4cedbb2a5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:53.055600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:53.101594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:53.102186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:53.102459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:53.102725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:53.103330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:53.106089 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:53.229355 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1209/2414] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:48:53 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:48:53.234392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:53.245098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d231fe0-608f-49b8-a9fe-7420aa0b0526 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:53.249698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:53.250288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:53.250569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:53.250867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:53.251664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:53.253305 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:53.263299 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1206/2415] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:53.267380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:53.278159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5370d-34eb-4dfb-8d30-a2dc05df2b03 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:53.282876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a820a-27a9-434a-b5bf-100ea266dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:53.283617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a820a-27a9-434a-b5bf-100ea266dae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:53.283900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a820a-27a9-434a-b5bf-100ea266dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:53.284285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a820a-27a9-434a-b5bf-100ea266dae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:53.285024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a820a-27a9-434a-b5bf-100ea266dae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:53.286957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a820a-27a9-434a-b5bf-100ea266dae3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:53.298772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1210/2416] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:48:53.302891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:53.313184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9546624-9635-4a5a-8b29-1ecd6acc4e1d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:53.317708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:53.318351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:53.318627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:53.318896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] PATH_INFO: `/v3/projects/7aeca3e3ecf045cd86b34c79f835d50e/users/f8d99ea85b52442f97fdc0383b759f7f/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:53.334288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aeca3e3ecf045cd86b34c79f835d50e, user_id=f8d99ea85b52442f97fdc0383b759f7f, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:53.337020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:53.438819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1207/2417] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:48:53 2022] PUT /identity/v3/projects/7aeca3e3ecf045cd86b34c79f835d50e/users/f8d99ea85b52442f97fdc0383b759f7f/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:48:53.443935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e879a-2770-468b-824e-3aba7483c6fa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:53.444236 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e879a-2770-468b-824e-3aba7483c6fa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:53.444534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e879a-2770-468b-824e-3aba7483c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:53.466286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f10e879a-2770-468b-824e-3aba7483c6fa None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:53.467792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f10e879a-2770-468b-824e-3aba7483c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:53.528535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1211/2418] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:53.537697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:53.540586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:53.572185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:48:53.602316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464571-fd64-4e32-8c18-75777adf8ccb admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:53.606250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4005-0b14-4bc6-9037-4597ad53de07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:53.606854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4005-0b14-4bc6-9037-4597ad53de07 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:53.607137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4005-0b14-4bc6-9037-4597ad53de07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:53.607404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4005-0b14-4bc6-9037-4597ad53de07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:53.618401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4005-0b14-4bc6-9037-4597ad53de07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:53.619847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4005-0b14-4bc6-9037-4597ad53de07 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:53.631773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1208/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:48:54.231829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a33a-b5f7-4bf3-aa53-3728afe22e39 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:54.232377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a33a-b5f7-4bf3-aa53-3728afe22e39 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:54.232377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a33a-b5f7-4bf3-aa53-3728afe22e39 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:54.234097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1212/2420] 10.222.0.64 () {54 vars in 961 bytes} [Fri Sep 9 11:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:48:54.245407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3ebfd-2629-4a92-8fb2-5d1ff7290854 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:54.246027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3ebfd-2629-4a92-8fb2-5d1ff7290854 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:54.246027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3ebfd-2629-4a92-8fb2-5d1ff7290854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:54.267019 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-22d3ebfd-2629-4a92-8fb2-5d1ff7290854 None None] MFA Rules not processed for user `98c4b86c13494f3fb1ff2957a2cbdf45`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:54.268255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-22d3ebfd-2629-4a92-8fb2-5d1ff7290854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:54.336407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1209/2421] 10.222.0.64 () {58 vars in 1058 bytes} [Fri Sep 9 11:48:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:48:54.348384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022a33a-b5f7-4bf3-aa53-3728afe22e39 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:48:54.366875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022a33a-b5f7-4bf3-aa53-3728afe22e39 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:48:54.373905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:48:54.374613 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:54.374925 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:54.375196 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:54.377028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:48:54.391166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:48:54.391532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:48:54.402068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1213/2422] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:48:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:48:59.874130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:48:59.881143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:48:59.881143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:48:59.911063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] MFA Rules not processed for user `f8d99ea85b52442f97fdc0383b759f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:48:59.912069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:00.013391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1210/2423] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:00.022560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:00.047031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029de62-5c72-40eb-b60c-57d6a42e7d81 service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:00.047031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:00.047031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:00.047031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:00.047517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:00.047517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:00.047517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:00.233246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1214/2424] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:49:00 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:49:00.233975 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:00.249033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c434f5-a7c1-4556-8d58-885a524e4d96 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:00.305303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:00.313162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:00.313850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:00.325942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:00.325942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:00.325942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:00.325942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:00.448811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1211/2425] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:49:00 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:49:00.452878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:00.463673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbf7ba-97ec-4fce-952f-d05a252c469d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:00.468733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:00.469370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:00.469649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:00.469919 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:00.470554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:00.472157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:00.486661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1215/2426] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:49:00.489431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:00.500696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a415b-8a4b-4c29-aeea-6986f13892fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:00.505536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:00.506191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:00.506480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:00.506753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] PATH_INFO: `/v3/projects/82cc9c44a41944fd81b2455e3711b25d/users/763963a5cb5545c296f5d4319c8041ff/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:00.530665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cc9c44a41944fd81b2455e3711b25d, user_id=763963a5cb5545c296f5d4319c8041ff, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:00.533797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:00.670289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1212/2427] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:49:00 2022] PUT /identity/v3/projects/82cc9c44a41944fd81b2455e3711b25d/users/763963a5cb5545c296f5d4319c8041ff/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:49:00.674282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:00.685489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd6b0-4040-4511-8281-6faf9d6bf2b7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:00.741003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:00.755164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7e33c-ce6c-405d-9855-5af247ffa998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:00.756264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e33c-ce6c-405d-9855-5af247ffa998 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:00.756709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e33c-ce6c-405d-9855-5af247ffa998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:00.757127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e33c-ce6c-405d-9855-5af247ffa998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:00.758114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7e33c-ce6c-405d-9855-5af247ffa998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:00.759749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7e33c-ce6c-405d-9855-5af247ffa998 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:00.785802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1216/2428] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:49:00.790003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:00.802285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3938-0beb-44c8-b7d4-c4251838020c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:00.807971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7df99-c67d-4338-8571-d480971ec89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:00.808569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7df99-c67d-4338-8571-d480971ec89a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:00.808851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7df99-c67d-4338-8571-d480971ec89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:00.809127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7df99-c67d-4338-8571-d480971ec89a admin admin] PATH_INFO: `/v3/projects/82cc9c44a41944fd81b2455e3711b25d/users/763963a5cb5545c296f5d4319c8041ff/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:00.811150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7df99-c67d-4338-8571-d480971ec89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cc9c44a41944fd81b2455e3711b25d, user_id=763963a5cb5545c296f5d4319c8041ff, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:00.813923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7df99-c67d-4338-8571-d480971ec89a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:00.826007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1213/2429] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:49:00 2022] PUT /identity/v3/projects/82cc9c44a41944fd81b2455e3711b25d/users/763963a5cb5545c296f5d4319c8041ff/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:49:08.370862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8b433-a538-43de-b038-947127a62f85 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:08.371403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8b433-a538-43de-b038-947127a62f85 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:08.371546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8b433-a538-43de-b038-947127a62f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:08.423913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-79d8b433-a538-43de-b038-947127a62f85 None None] MFA Rules not processed for user `763963a5cb5545c296f5d4319c8041ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:08.482450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-79d8b433-a538-43de-b038-947127a62f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:08.483431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d05b-8db4-4c03-87c2-56d92c477c45 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:08.483431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d05b-8db4-4c03-87c2-56d92c477c45 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:08.483431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d05b-8db4-4c03-87c2-56d92c477c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:08.483431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e101d05b-8db4-4c03-87c2-56d92c477c45 None None] MFA Rules not processed for user `0cd53e0265824f54839c856591e85b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:08.483431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e101d05b-8db4-4c03-87c2-56d92c477c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:08.566425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1217/2430] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:49:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:08.569964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1214/2431] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:49:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:08.580410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8b433-a538-43de-b038-947127a62f85 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:08.582115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-79d8b433-a538-43de-b038-947127a62f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:08.665663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8b433-a538-43de-b038-947127a62f85 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:08.671818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d040-a129-4272-ae9c-b40de28b7aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:08.672448 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d040-a129-4272-ae9c-b40de28b7aaa service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:08.672725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d040-a129-4272-ae9c-b40de28b7aaa service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:08.673000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d040-a129-4272-ae9c-b40de28b7aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:08.747684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d040-a129-4272-ae9c-b40de28b7aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:08.749425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d040-a129-4272-ae9c-b40de28b7aaa service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:08.761424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1218/2432] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:49:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:49:12.471267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760effc1-e8a8-4a53-9a13-fd8b483871bf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:12.471762 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760effc1-e8a8-4a53-9a13-fd8b483871bf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:12.471887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760effc1-e8a8-4a53-9a13-fd8b483871bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:12.492079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-760effc1-e8a8-4a53-9a13-fd8b483871bf None None] MFA Rules not processed for user `f8d99ea85b52442f97fdc0383b759f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:12.495638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-760effc1-e8a8-4a53-9a13-fd8b483871bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:12.501276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1215/2433] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:18.756492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:22.488020 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=47,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:26.618013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:26.619567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:26.619567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:26.645782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] MFA Rules not processed for user `25aa1cfa72db4e789990a0015da397d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:26.646994 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:26.702465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1219/2434] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:36.694918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=25 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:37.230987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4ac9-c09b-4d7f-aa83-9bf7b76c4b2d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:37.231546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4ac9-c09b-4d7f-aa83-9bf7b76c4b2d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:37.231637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4ac9-c09b-4d7f-aa83-9bf7b76c4b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:37.253021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2cfc4ac9-c09b-4d7f-aa83-9bf7b76c4b2d None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:37.254431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2cfc4ac9-c09b-4d7f-aa83-9bf7b76c4b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:37.332553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1216/2435] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:37.358391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:37.359885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:37.439971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ade18-e1a8-4998-adab-c1f52780449a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:37.446461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:37.447455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:37.447800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:37.448277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:37.458193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:37.459938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:37.470822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1220/2436] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:49:46.015435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95241-e322-4e68-9284-653ef2ce5ee0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:46.016038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95241-e322-4e68-9284-653ef2ce5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:46.016281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95241-e322-4e68-9284-653ef2ce5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:46.037799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-04e95241-e322-4e68-9284-653ef2ce5ee0 None None] MFA Rules not processed for user `61ed413fdfab427287e7355612a795b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:46.039037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-04e95241-e322-4e68-9284-653ef2ce5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:46.105372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1217/2437] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:49:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:47.467410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=32 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:47.924530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:48.001467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef861e8-8251-4d96-9a28-b14895e76069 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:48.008426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:48.009377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:48.009758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:48.010139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:48.021839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:48.023508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:48.035896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1221/2438] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:49:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:49:56.095769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=50 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:58.033799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=26 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:49:58.095183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d4ee-630a-4990-99d4-48c135906b0e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:58.095653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d4ee-630a-4990-99d4-48c135906b0e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:58.095769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d4ee-630a-4990-99d4-48c135906b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:58.120280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8872d4ee-630a-4990-99d4-48c135906b0e None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:58.122525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8872d4ee-630a-4990-99d4-48c135906b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:58.130320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1218/2439] 10.222.0.64 () {58 vars in 967 bytes} [Fri Sep 9 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:49:58.143643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:49:58.155653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b399-d32b-49d2-8829-7b3bee198d41 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:49:58.161115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:49:58.161838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:58.162033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:58.162296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:58.181864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:49:58.183474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:49:58.192147 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1222/2440] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:49:59.386784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:49:59.387314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:49:59.387430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:49:59.408347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] MFA Rules not processed for user `0a1b019c66e3439a8eb18890e1f05bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:49:59.409616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:49:59.467828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1219/2441] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:49:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:50:01.586711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:01.588281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:01.665995 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa220e40-e44c-4e99-8c1c-d5509e01a215 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:01.670595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:01.671210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:01.671510 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:01.671780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] PATH_INFO: `/v3/users/0cd53e0265824f54839c856591e85b77` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:01.672872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd53e0265824f54839c856591e85b77)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:01.674829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:01.860320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd53e0265824f54839c856591e85b77'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:01.860975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd53e0265824f54839c856591e85b77'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:01.955644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd53e0265824f54839c856591e85b77'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:01.964220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd53e0265824f54839c856591e85b77'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:01.964926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fe0821e2-b46f-405e-a791-82d4ef209864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd53e0265824f54839c856591e85b77'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:01.990941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1223/2442] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:50:01 2022] DELETE /identity/v3/users/0cd53e0265824f54839c856591e85b77 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:02.274841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:02.285947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db692f4-cc0d-49db-99b9-2199ccc00ce4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:02.345508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:02.346066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:02.346339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:02.346780 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] PATH_INFO: `/v3/projects/fd7f4fc6b9c34f2a81204baf44066353` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:02.348809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7f4fc6b9c34f2a81204baf44066353)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:02.350851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:02.491991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7f4fc6b9c34f2a81204baf44066353', 'request_id': 'req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:02.499104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7f4fc6b9c34f2a81204baf44066353', 'request_id': 'req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:02.564027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7f4fc6b9c34f2a81204baf44066353', 'request_id': 'req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:02.578139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] The token cache is being invalidate because project fd7f4fc6b9c34f2a81204baf44066353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:50:02.578426 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:02.579216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1635a1d7-80fd-4d96-a2b5-bde3fad410a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:02.580823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1220/2443] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:50:02 2022] DELETE /identity/v3/projects/fd7f4fc6b9c34f2a81204baf44066353 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:50:02.587059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:02.587575 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:02.587882 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:02.608835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:02.610115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:02.674676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1224/2444] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:02.683670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:02.683952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:02.684411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:02.705842 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:02.707033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:02.715268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1221/2445] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:02.719742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:02.729800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5df47-2703-4435-a3b0-126730470cc8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:02.734357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:02.734947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:02.735223 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:02.735491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:02.736126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:50:02.736421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:02.738276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:02.740001 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:02.751450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1225/2446] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:50:02.755849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:02.766220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827b22-2d10-4e3f-a2f0-a5dce71e83c5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:02.771132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:02.771863 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:02.772173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:02.772442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:02.773738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:02.775625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:02.876736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:02.883047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1222/2447] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:50:02 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:50:02.887180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:02.898374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06ba73-538a-4cfc-b9ab-e50719fc4a28 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:02.954345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:02.954940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:02.955218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:02.955487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:02.956149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:02.958117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:03.081522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1226/2448] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:50:02 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:50:03.082812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:03.094170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c95a-8440-42b9-9134-1af6dc49a3ac admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:03.099946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:03.100580 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:03.101423 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:03.101693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:03.102363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:03.103965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:03.114971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1223/2449] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:50:03.119943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:03.130443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30745a-f115-4d9e-821e-7aa3bcff56f0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:03.135302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec62b5-7628-496d-a044-7695f0937320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:03.135890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec62b5-7628-496d-a044-7695f0937320 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:03.136174 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec62b5-7628-496d-a044-7695f0937320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:03.136445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec62b5-7628-496d-a044-7695f0937320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:03.137076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec62b5-7628-496d-a044-7695f0937320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:03.138733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec62b5-7628-496d-a044-7695f0937320 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:03.149701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1227/2450] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:50:03.153907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:03.164473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ad5d-ea59-418c-a450-0d590a1187fb admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:03.169039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:03.169712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:03.169991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:03.170262 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] PATH_INFO: `/v3/projects/307a2a2c57f74c419ec9e3e8355295a0/users/fc2668b1c6274519a77f4ab31b246b76/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:03.186345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307a2a2c57f74c419ec9e3e8355295a0, user_id=fc2668b1c6274519a77f4ab31b246b76, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:03.189021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:03.269763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1224/2451] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:50:03 2022] PUT /identity/v3/projects/307a2a2c57f74c419ec9e3e8355295a0/users/fc2668b1c6274519a77f4ab31b246b76/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:03.280821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:03.281108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:03.281412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:03.310040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] MFA Rules not processed for user `fc2668b1c6274519a77f4ab31b246b76`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:03.311255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:03.376462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1228/2452] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:03.387300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:03.388974 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:03.447382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c12d-e91b-4821-a6a4-cc99465a9064 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:03.451127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b63696-4acf-4271-b503-60ac1d798640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:03.451820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b63696-4acf-4271-b503-60ac1d798640 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:03.452167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b63696-4acf-4271-b503-60ac1d798640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:03.452503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b63696-4acf-4271-b503-60ac1d798640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:03.462428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b63696-4acf-4271-b503-60ac1d798640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:03.463953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b63696-4acf-4271-b503-60ac1d798640 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:03.475165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1225/2453] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:13.373780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:13.470534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:15.572618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:15.668292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d23d4-8af1-4da9-9829-ff2132f8ddfa None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:15.673073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:15.673799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:15.674096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:15.674352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] PATH_INFO: `/v3/users/fc2668b1c6274519a77f4ab31b246b76` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:15.675522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2668b1c6274519a77f4ab31b246b76)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:15.677516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:15.883273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2668b1c6274519a77f4ab31b246b76'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:15.883960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2668b1c6274519a77f4ab31b246b76'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:15.949601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2668b1c6274519a77f4ab31b246b76'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:15.957895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2668b1c6274519a77f4ab31b246b76'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:15.958631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2668b1c6274519a77f4ab31b246b76'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:15.978555 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1229/2454] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:50:15 2022] DELETE /identity/v3/users/fc2668b1c6274519a77f4ab31b246b76 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:15.983166 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:15.983742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:15.983742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:16.004512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:16.005766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:16.074566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1226/2455] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:16.085070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:16.086701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:16.148327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d080895-660b-4183-9813-28eabd113d41 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:16.152280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:16.152883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:16.153159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:16.153462 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:16.163454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:16.165170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:16.174992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1230/2456] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:16.730714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:16.732545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:16.750340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fd85c-27bf-4ef7-94b1-f08c8b48c14f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:16.757430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:16.761092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:16.761092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:16.761092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] PATH_INFO: `/v3/projects/307a2a2c57f74c419ec9e3e8355295a0` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:16.761092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307a2a2c57f74c419ec9e3e8355295a0)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:16.763007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:16.932878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307a2a2c57f74c419ec9e3e8355295a0', 'request_id': 'req-4903f0d1-2588-4f7d-b559-d1debc119071'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:16.943461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307a2a2c57f74c419ec9e3e8355295a0', 'request_id': 'req-4903f0d1-2588-4f7d-b559-d1debc119071'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:17.029564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307a2a2c57f74c419ec9e3e8355295a0', 'request_id': 'req-4903f0d1-2588-4f7d-b559-d1debc119071'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:17.044311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] The token cache is being invalidate because project 307a2a2c57f74c419ec9e3e8355295a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:50:17.044628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:17.045309 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:17.046933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1227/2457] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:50:16 2022] DELETE /identity/v3/projects/307a2a2c57f74c419ec9e3e8355295a0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:26.170755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:27.041043 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:43.411468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:43.413731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:43.428521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4462f-7860-4d8f-9358-512b2d5a9dfc service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:43.485500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:43.486032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:43.486303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:43.486576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] PATH_INFO: `/v3/users/25aa1cfa72db4e789990a0015da397d4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:43.487701 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=25aa1cfa72db4e789990a0015da397d4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:43.490543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:43.719602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25aa1cfa72db4e789990a0015da397d4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:43.720380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25aa1cfa72db4e789990a0015da397d4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:43.779049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25aa1cfa72db4e789990a0015da397d4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:43.787260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25aa1cfa72db4e789990a0015da397d4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:43.787934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25aa1cfa72db4e789990a0015da397d4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:43.806162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1231/2458] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:50:43 2022] DELETE /identity/v3/users/25aa1cfa72db4e789990a0015da397d4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:43.816007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:43.817604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:43.875467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903f0d1-2588-4f7d-b559-d1debc119071 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:43.923840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:43.924370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:43.924646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:43.924915 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:43.927395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:43.993015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:43.994493 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa60f7-5457-40e6-85e3-62908f1a0642 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:44.004251 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1228/2459] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:44.243634 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:44.245313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:44.267227 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab87cfe-b98f-4d84-855c-05d8cf87a7ca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:44.273601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:44.274228 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.274534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.274937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] PATH_INFO: `/v3/projects/0eeaad89472d465aac7ffc3ebe7c6b29` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.276073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eeaad89472d465aac7ffc3ebe7c6b29)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:44.278097 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:44.424344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eeaad89472d465aac7ffc3ebe7c6b29', 'request_id': 'req-279f87d0-46c3-4056-a182-6db3ce23d8cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:44.505307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eeaad89472d465aac7ffc3ebe7c6b29', 'request_id': 'req-279f87d0-46c3-4056-a182-6db3ce23d8cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:44.511782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eeaad89472d465aac7ffc3ebe7c6b29', 'request_id': 'req-279f87d0-46c3-4056-a182-6db3ce23d8cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:44.523664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] The token cache is being invalidate because project 0eeaad89472d465aac7ffc3ebe7c6b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:50:44.523945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:44.524570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-279f87d0-46c3-4056-a182-6db3ce23d8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:50:44.526166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1232/2460] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:50:44 2022] DELETE /identity/v3/projects/0eeaad89472d465aac7ffc3ebe7c6b29 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:44.531123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.531442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.531736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.551570 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:44.553157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:44.618441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1229/2461] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:44.626367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.626648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.626916 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.635257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:44.648237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:44.649483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:44.657364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1233/2462] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:44.661793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:44.673906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f547e-d14e-4577-9fde-f8f3374e5c3b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:44.680935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:44.681505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.681785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.682054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.682695 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:50:44.682995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:44.684596 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:44.686225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:44.697919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1230/2463] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:50:44.702360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:44.712628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c7b46-cd83-4d3a-b615-0b759c1adb75 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:44.717830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:44.718421 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.718695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.718963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.719592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:44.721534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:44.812342 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1234/2464] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:50:44 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:50:44.816738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:44.827560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770eba1-d977-46f9-b9d8-2b9df698b2e1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:44.884901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:44.885534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.885815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.886086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.886708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:44.888623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:44.967815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1231/2465] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:50:44 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:50:44.972116 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:44.982571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85539-d8f1-4407-b164-db01c47dfbef admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:44.987165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:44.987761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:44.988040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:44.988307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:44.988999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:44.991252 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:45.001281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1235/2466] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:50:45.005158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:45.016393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3027c3-085c-4363-b3d5-2025b1e9c706 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:45.021535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea21a24-5f19-4700-9d7c-f9ed57eb0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:45.022459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea21a24-5f19-4700-9d7c-f9ed57eb0604 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:45.022745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea21a24-5f19-4700-9d7c-f9ed57eb0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:45.023018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea21a24-5f19-4700-9d7c-f9ed57eb0604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:45.023674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea21a24-5f19-4700-9d7c-f9ed57eb0604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:45.025266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea21a24-5f19-4700-9d7c-f9ed57eb0604 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:45.035786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1232/2467] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:50:45.040217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:45.050318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc454-43cc-42fe-83b9-d20e7da2679a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:45.055842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:45.056479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:45.056758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:45.057031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] PATH_INFO: `/v3/projects/37653d430e7d44c88dee1e31439c4a7a/users/5694e0c4dda94544bad91e5b9cb13b89/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:45.072370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37653d430e7d44c88dee1e31439c4a7a, user_id=5694e0c4dda94544bad91e5b9cb13b89, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:45.075171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:45.199801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1236/2468] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:50:45 2022] PUT /identity/v3/projects/37653d430e7d44c88dee1e31439c4a7a/users/5694e0c4dda94544bad91e5b9cb13b89/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:50:45.204899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc45e-ee97-423c-837e-58ef1ca968c3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:45.205205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc45e-ee97-423c-837e-58ef1ca968c3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:45.205524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc45e-ee97-423c-837e-58ef1ca968c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:45.226047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-88bcc45e-ee97-423c-837e-58ef1ca968c3 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:45.227326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-88bcc45e-ee97-423c-837e-58ef1ca968c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:45.288880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1233/2469] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:45.298631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:45.300377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:45.359144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123e1af-1bdc-43a7-b86e-f83a75c05b22 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:45.362743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:45.363332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:45.363606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:45.363867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:45.373802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:45.375306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:45.384880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1237/2470] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:51.274389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:51.275003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:51.275243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:51.318663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] MFA Rules not processed for user `5694e0c4dda94544bad91e5b9cb13b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:51.322757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:51.408665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1234/2471] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:51.426598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:51.429277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:51.516153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62101b-e321-47af-b3ba-3a2825a160ac service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:51.523206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:51.523968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:51.524316 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:51.524644 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:51.533614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:51.535258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:51.547088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1238/2472] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:52.723492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:52.726044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:52.733236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:52.788295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378040b5-9bfc-4ce3-8b6e-98a3601b6040 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:52.792047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:52.797080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:52.797080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:52.797080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:52.797080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:52.809813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:52.811279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5a82d-be1f-495c-81f8-cef6e149026c service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:52.823169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1235/2473] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:53.072990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:53.074618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:53.087570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dcf9-c353-4afc-ace1-08369b981a29 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:53.091895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:53.092486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:53.092781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:53.093047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:53.094832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:53.109642 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:53.112934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:53.122803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1239/2474] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:50:54.002568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:54.003128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:54.003229 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:54.024430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] MFA Rules not processed for user `5694e0c4dda94544bad91e5b9cb13b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:50:54.025942 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:54.033346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1236/2475] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:50:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:50:59.047532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:50:59.059495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38a3a6-c4ed-401d-a5a1-7a6d501e7c69 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:50:59.065188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:50:59.065819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:50:59.069529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:50:59.069529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:50:59.070000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:50:59.082982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:50:59.134461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:50:59.136069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88891b11-a817-4e82-87cb-dbb4eb5f5a7b service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:50:59.145383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1240/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:50:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:04.018255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=28 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:05.216576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:05.218150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:05.234354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54b1cb-4aed-4512-a1be-fd2a46deb3bd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:05.239875 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:05.240502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:05.241747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:05.242038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:05.243930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:05.306726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:05.308364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:05.319422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1237/2477] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:07.062558 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:07.062980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:07.063110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:07.083098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:07.084368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:07.140375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1241/2478] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:51:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:07.274731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:07.276174 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:07.352227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504badc2-ae63-4b30-90ce-427fe0142395 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:07.357377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:07.357976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:07.358253 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:07.358520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:07.366538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:07.368552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:07.376895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1238/2479] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:51:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:51:17.133717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=47 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:17.373435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=60 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:18.829031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:18.840071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca63eb-a553-48d3-8721-1f65da8188f9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:18.843615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:18.844210 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:18.844487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:18.844754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:18.846536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:18.857297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:18.858727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527010f-213b-460e-8ecc-4ada400ebc13 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:18.867467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1242/2480] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:19.288525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:19.305259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0791b3-751f-4822-8f36-5ca5d32ffe52 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:19.313194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:19.314022 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:19.314459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:19.314903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:19.317203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:19.349761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:19.352455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d0348-ae4c-466f-9331-6de6a40f4f71 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:19.365790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1239/2481] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:25.409171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306f60-40a6-4170-a2e7-c3cb54c36d6b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.409715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306f60-40a6-4170-a2e7-c3cb54c36d6b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.409908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306f60-40a6-4170-a2e7-c3cb54c36d6b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.411630 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1243/2482] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:51:25.424803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840354-e795-4f32-95ac-ee9a5d3b9e36 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.425337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840354-e795-4f32-95ac-ee9a5d3b9e36 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.425753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840354-e795-4f32-95ac-ee9a5d3b9e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.446662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-36840354-e795-4f32-95ac-ee9a5d3b9e36 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:25.447884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-36840354-e795-4f32-95ac-ee9a5d3b9e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:25.457241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1240/2483] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:51:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:25.469500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5306f60-40a6-4170-a2e7-c3cb54c36d6b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:25.481150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5306f60-40a6-4170-a2e7-c3cb54c36d6b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:25.484914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdb857-1ee1-4463-b58a-1d327d8aaef1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:25.485586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdb857-1ee1-4463-b58a-1d327d8aaef1 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.487653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdb857-1ee1-4463-b58a-1d327d8aaef1 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.487653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdb857-1ee1-4463-b58a-1d327d8aaef1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.497093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdb857-1ee1-4463-b58a-1d327d8aaef1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:25.498549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdb857-1ee1-4463-b58a-1d327d8aaef1 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:25.509504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1244/2484] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:51:25.731287 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa051d7-410d-4153-b5a6-44bd5367ea7d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.731587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa051d7-410d-4153-b5a6-44bd5367ea7d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.731885 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa051d7-410d-4153-b5a6-44bd5367ea7d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.733286 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1241/2485] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:51:25.738055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606255fe-35df-49f1-abd4-c1c406c9e3e8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.738336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606255fe-35df-49f1-abd4-c1c406c9e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.738604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606255fe-35df-49f1-abd4-c1c406c9e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.758900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-606255fe-35df-49f1-abd4-c1c406c9e3e8 None None] MFA Rules not processed for user `f342c15c234b4d6592404de7e7bee866`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:25.760606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-606255fe-35df-49f1-abd4-c1c406c9e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:25.767541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1245/2486] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:51:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:25.780813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa051d7-410d-4153-b5a6-44bd5367ea7d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:25.792734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa051d7-410d-4153-b5a6-44bd5367ea7d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:25.796421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aaec2-906b-4356-a1d8-adf948205769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:25.797009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aaec2-906b-4356-a1d8-adf948205769 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.797315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aaec2-906b-4356-a1d8-adf948205769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.797586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aaec2-906b-4356-a1d8-adf948205769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.804782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aaec2-906b-4356-a1d8-adf948205769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:25.812341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aaec2-906b-4356-a1d8-adf948205769 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:25.813890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1242/2487] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:25.898162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b77c5-b7dc-44d8-b9dc-84c14f212149 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.898633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b77c5-b7dc-44d8-b9dc-84c14f212149 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.898911 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b77c5-b7dc-44d8-b9dc-84c14f212149 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.900514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1246/2488] 10.222.0.64 () {54 vars in 921 bytes} [Fri Sep 9 11:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:51:25.906115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.906499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.906772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.926488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] MFA Rules not processed for user `f354bf4e63d949ecbb86b123a7022293`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:25.927676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:25.937265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1243/2489] 10.222.0.64 () {58 vars in 1018 bytes} [Fri Sep 9 11:51:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:51:25.948037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b77c5-b7dc-44d8-b9dc-84c14f212149 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:25.959309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b77c5-b7dc-44d8-b9dc-84c14f212149 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:25.963764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:25.964352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:25.964884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:25.965159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:25.975394 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:25.976963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:25.988047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1247/2490] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:26.061061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:26.062471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:26.130324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21653b0-0752-45b6-a388-ef2441ae4109 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:26.136203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:26.136811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:26.137124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:26.137475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:26.139209 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:26.150902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:26.152464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0837-8bd4-434c-a755-05148346b557 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:26.162468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1244/2491] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:27.936432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:27.945709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035bc9-1bee-4c3d-aed3-e26439c2c845 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:27.949469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:27.950099 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:27.950379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:27.951093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:27.952389 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:27.965894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:27.969785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:27.979378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1248/2492] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:29.484734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:29.485270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:29.485374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:29.506690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:29.508222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:29.515608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1245/2493] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:51:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:51:29.528164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:29.540188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85395-c880-4377-9357-186f466a9bdf service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:29.545529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:29.547190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:29.547190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:29.547190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:29.555577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:29.557145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:29.565182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1249/2494] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:51:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:51:32.758433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:32.773655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886fae1-2cf1-44c0-b04d-221807d65e1b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:32.793479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:32.794710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:32.795248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:32.795821 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:32.798474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:32.818051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:32.823095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:32.846602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1246/2495] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:33.236014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:33.237563 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:33.254087 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840d759-103c-4dba-ae3b-e401ae67ce3a service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:33.259835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:33.260713 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:33.261173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:33.261638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] PATH_INFO: `/v3/users/0a1b019c66e3439a8eb18890e1f05bcd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:33.263021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1b019c66e3439a8eb18890e1f05bcd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:33.265124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:33.467508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1b019c66e3439a8eb18890e1f05bcd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:33.468191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1b019c66e3439a8eb18890e1f05bcd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:33.525826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1b019c66e3439a8eb18890e1f05bcd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:33.533679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1b019c66e3439a8eb18890e1f05bcd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:33.535140 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddf97212-38e8-41bb-a15c-01e7ac319e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1b019c66e3439a8eb18890e1f05bcd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:33.557950 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1250/2496] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:51:33 2022] DELETE /identity/v3/users/0a1b019c66e3439a8eb18890e1f05bcd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:33.856586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:33.870720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2276d-9dff-45a2-be1e-0fe0b8098261 service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:33.933357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:33.933986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:33.934268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:33.934542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] PATH_INFO: `/v3/projects/9ff6925154714c7fa1136aeeced7fb70` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:33.935674 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff6925154714c7fa1136aeeced7fb70)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:33.937648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.051720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:34.065334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff6925154714c7fa1136aeeced7fb70', 'request_id': 'req-910e23af-6fc5-456b-ae46-a6a4fa28a87c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:34.075265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff6925154714c7fa1136aeeced7fb70', 'request_id': 'req-910e23af-6fc5-456b-ae46-a6a4fa28a87c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:34.135073 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff6925154714c7fa1136aeeced7fb70', 'request_id': 'req-910e23af-6fc5-456b-ae46-a6a4fa28a87c'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:34.148499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] The token cache is being invalidate because project 9ff6925154714c7fa1136aeeced7fb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:51:34.148791 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:34.149688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-910e23af-6fc5-456b-ae46-a6a4fa28a87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:34.151192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1247/2497] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:51:33 2022] DELETE /identity/v3/projects/9ff6925154714c7fa1136aeeced7fb70 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:51:34.156168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.156457 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.156732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.177193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:34.178476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:34.248829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:34.281388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1251/2498] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:34.285613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.285892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.286160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.316809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:34.319590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:34.327577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1248/2499] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:34.331624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:34.342777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444006-b3f8-4f80-82ac-508122fa9670 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:34.347908 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:34.348811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.349367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.349913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.350602 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:51:34.350895 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:34.352746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.366936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1252/2500] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:51:34.371711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:34.382828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cdcc9-4a87-4473-b1c3-663dda73c878 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:34.388237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:34.389071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.389739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.390014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.390651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:34.392771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.488798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1249/2501] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:34 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:34.493221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:34.503669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e37f7a-e0d7-428c-b47f-785547dbcef1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:34.576157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:34.577117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.577531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.577794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.578530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:34.582167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.670660 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1253/2502] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:34 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:34.674401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:34.687030 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a443d-0e7e-4628-82c6-0745d795e068 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:34.692050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:34.692647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.692927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.693338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.694323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:34.695996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.706494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1250/2503] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:34.711049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:34.721468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8c4b4-fe9b-4e78-aeaf-a08220421a57 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:34.726797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a4a6-981e-4c1f-b2c9-cc7748092874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:34.727388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a4a6-981e-4c1f-b2c9-cc7748092874 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.727669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a4a6-981e-4c1f-b2c9-cc7748092874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.727942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a4a6-981e-4c1f-b2c9-cc7748092874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.728578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805a4a6-981e-4c1f-b2c9-cc7748092874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:34.730208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805a4a6-981e-4c1f-b2c9-cc7748092874 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.741186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1254/2504] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:34.745697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:34.757854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89777a-651f-41db-bd2e-60ffd1d8ea29 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:34.763461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:34.764241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.764520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.764793 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] PATH_INFO: `/v3/projects/d3cb70cc63dd4a31827b42ba6a4a651e/users/422c30f9897c42f1a1d26757b7f78206/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.781508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cb70cc63dd4a31827b42ba6a4a651e, user_id=422c30f9897c42f1a1d26757b7f78206, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:34.784540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:34.854255 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1251/2505] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:34 2022] PUT /identity/v3/projects/d3cb70cc63dd4a31827b42ba6a4a651e/users/422c30f9897c42f1a1d26757b7f78206/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:34.866932 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:34.868298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:34.868694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:34.911475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] MFA Rules not processed for user `422c30f9897c42f1a1d26757b7f78206`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:34.913580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:34.992955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1255/2506] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:34.997233 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:35.072149 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45f90-bf25-4e09-9086-e92463dfee3e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:35.077890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:35.078647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:35.078929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:35.079217 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:35.080007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:35.082059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:35.477497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1252/2507] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:34 2022] POST /identity/v3/projects => generated 363 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:35.495678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:35.515649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4644bd-c6aa-4531-98a4-75c1f0f83690 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:35.647841 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:35.654906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:35.655860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:35.656240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:35.656557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:35.657300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:35.659330 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:35.890914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1256/2508] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:35 2022] POST /identity/v3/users => generated 288 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:35.895069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:35.907972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc303c-40bf-4233-9083-bdc10022d9e8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:35.913804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:35.914633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:35.915451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:35.915978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:35.916873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:35.919270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:35.936036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1253/2509] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:35.940722 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:35.954735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90fa8-5f1b-4646-88c9-5f52ea3d9232 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:35.961633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:35.962487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:35.962914 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:35.963303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] PATH_INFO: `/v3/projects/7e0cd3f7472d4e0bad903d97771ecbc7/users/8cae5193205f4467a8bcc34cec0fbeba/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:35.986290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0cd3f7472d4e0bad903d97771ecbc7, user_id=8cae5193205f4467a8bcc34cec0fbeba, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:35.989957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:36.064201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1257/2510] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:35 2022] PUT /identity/v3/projects/7e0cd3f7472d4e0bad903d97771ecbc7/users/8cae5193205f4467a8bcc34cec0fbeba/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:36.068951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:36.081810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef91e8-0fbf-44c0-98f9-4566a8a3d897 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:36.121759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:36.154123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49290211-23e1-4d94-a71e-0f382754c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:36.154742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290211-23e1-4d94-a71e-0f382754c908 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:36.155183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290211-23e1-4d94-a71e-0f382754c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:36.155798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290211-23e1-4d94-a71e-0f382754c908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:36.156545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49290211-23e1-4d94-a71e-0f382754c908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:36.158277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49290211-23e1-4d94-a71e-0f382754c908 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:36.169837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1254/2511] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:51:36.173980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:36.185487 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0555d-b730-4f31-9cd5-d66b50920f59 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:36.191380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:36.191380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:36.191380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:36.191684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] PATH_INFO: `/v3/projects/7e0cd3f7472d4e0bad903d97771ecbc7/users/8cae5193205f4467a8bcc34cec0fbeba/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:36.193364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0cd3f7472d4e0bad903d97771ecbc7, user_id=8cae5193205f4467a8bcc34cec0fbeba, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:36.197118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:36.219476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1258/2512] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:36 2022] PUT /identity/v3/projects/7e0cd3f7472d4e0bad903d97771ecbc7/users/8cae5193205f4467a8bcc34cec0fbeba/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:51:36.227574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:36.227972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:36.228215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:36.265090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] MFA Rules not processed for user `8cae5193205f4467a8bcc34cec0fbeba`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:36.266519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:36.361260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1255/2513] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:51:36.371124 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:36.373490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:36.446391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996837a-4925-4015-8fda-e95a4c4d00c2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:36.450748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6b390-23f9-48ed-a80d-5fb2ff6611dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:36.451578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b390-23f9-48ed-a80d-5fb2ff6611dd service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:36.452009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b390-23f9-48ed-a80d-5fb2ff6611dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:36.452446 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b390-23f9-48ed-a80d-5fb2ff6611dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:36.463013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6b390-23f9-48ed-a80d-5fb2ff6611dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:36.464710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6b390-23f9-48ed-a80d-5fb2ff6611dd service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:36.485380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1259/2514] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:37.651341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:37.720593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc78eec-4fb4-45c8-a7bd-30e702629c8f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:37.725996 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:37.726625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:37.726907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:37.727177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] PATH_INFO: `/v3/users/422c30f9897c42f1a1d26757b7f78206` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:37.728339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422c30f9897c42f1a1d26757b7f78206)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:37.730322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:38.187221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422c30f9897c42f1a1d26757b7f78206'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:38.188102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422c30f9897c42f1a1d26757b7f78206'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:38.188718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422c30f9897c42f1a1d26757b7f78206'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:38.194892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:38.196908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422c30f9897c42f1a1d26757b7f78206'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:38.277671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422c30f9897c42f1a1d26757b7f78206'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:38.299099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1256/2515] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:51:37 2022] DELETE /identity/v3/users/422c30f9897c42f1a1d26757b7f78206 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:38.304194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:38.304758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:38.304758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:38.324122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:38.325362 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:38.384633 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1260/2516] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:38.394228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:38.395620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:38.456677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f107ff6-5651-449f-9786-3536cdfa9d11 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:38.460632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:38.461244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:38.461524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:38.461788 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:38.470949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:38.472411 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:38.482514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1257/2517] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:38.916273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:38.917806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:38.932454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189d82b-0128-47fc-87dc-5b094d5da534 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:38.937373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:38.938019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:38.938288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:38.939220 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] PATH_INFO: `/v3/projects/d3cb70cc63dd4a31827b42ba6a4a651e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:38.940552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cb70cc63dd4a31827b42ba6a4a651e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:38.942675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:39.048143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:39.051321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cb70cc63dd4a31827b42ba6a4a651e', 'request_id': 'req-096a3696-03a2-4abf-9007-64cdb05e741a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.143110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cb70cc63dd4a31827b42ba6a4a651e', 'request_id': 'req-096a3696-03a2-4abf-9007-64cdb05e741a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.151206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cb70cc63dd4a31827b42ba6a4a651e', 'request_id': 'req-096a3696-03a2-4abf-9007-64cdb05e741a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.162580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] The token cache is being invalidate because project d3cb70cc63dd4a31827b42ba6a4a651e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:51:39.162869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.163586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.165314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1261/2518] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:51:38 2022] DELETE /identity/v3/projects/d3cb70cc63dd4a31827b42ba6a4a651e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:39.169395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:39.180566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934bc2a-1b6b-4f58-bd0d-e30518a769f8 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:39.238961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:39.239578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:39.239851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:39.240115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] PATH_INFO: `/v3/users/8cae5193205f4467a8bcc34cec0fbeba` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:39.241382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cae5193205f4467a8bcc34cec0fbeba)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:39.243327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:39.430578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cae5193205f4467a8bcc34cec0fbeba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.431139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cae5193205f4467a8bcc34cec0fbeba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.431763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cae5193205f4467a8bcc34cec0fbeba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.438981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cae5193205f4467a8bcc34cec0fbeba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.528999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-23304893-9a5e-4ec3-8448-3e8983fb962d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cae5193205f4467a8bcc34cec0fbeba'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:39.539990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:39.547540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1258/2519] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:51:39 2022] DELETE /identity/v3/users/8cae5193205f4467a8bcc34cec0fbeba => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:39.989659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:39.992402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:40.004463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a3696-03a2-4abf-9007-64cdb05e741a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.063726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.064358 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.064632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.064902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] PATH_INFO: `/v3/projects/7e0cd3f7472d4e0bad903d97771ecbc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.066041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0cd3f7472d4e0bad903d97771ecbc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.067954 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.188441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0cd3f7472d4e0bad903d97771ecbc7', 'request_id': 'req-372f95ab-8a6e-44ae-99b4-43e6462b764e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:40.275548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0cd3f7472d4e0bad903d97771ecbc7', 'request_id': 'req-372f95ab-8a6e-44ae-99b4-43e6462b764e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:40.281771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0cd3f7472d4e0bad903d97771ecbc7', 'request_id': 'req-372f95ab-8a6e-44ae-99b4-43e6462b764e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:40.294083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] The token cache is being invalidate because project 7e0cd3f7472d4e0bad903d97771ecbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:51:40.294377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:40.296080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-372f95ab-8a6e-44ae-99b4-43e6462b764e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:40.297733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1262/2520] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:51:39 2022] DELETE /identity/v3/projects/7e0cd3f7472d4e0bad903d97771ecbc7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:40.302734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.303252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.303346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.325508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:40.326843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:40.401890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1259/2521] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:40.409785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.410115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.410388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.432655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:40.434021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:40.442208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1263/2522] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:40.447115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:40.457298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb15d-3496-43c1-92c6-b8068a3f9969 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.462106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.463770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.463770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.463770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.464079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:51:40.464468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.466104 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.478697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1260/2523] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:51:40.483606 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:40.493881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358615-46ff-47e9-a108-0d853b76950a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.498849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.499679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.500028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.500382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.501008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.502959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.593875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1264/2524] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:40 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:40.598115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:40.608961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c080f-affe-47ed-b8c3-b880d34a21d5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.671832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.672444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.672725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.672998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.673677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.675600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.787862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1261/2525] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:40 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:40.792645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:40.803004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dd282-cf86-4caa-a31f-0509dcf2ec86 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.807842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.808432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.808707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.808975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.809647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.811256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.821287 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1265/2526] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:40.825258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:40.835890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005789-7edc-44e0-b3c3-7038dd2a006f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.840732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1fd6e-e10f-4a24-95ad-3fe9c7fa879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.841352 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1fd6e-e10f-4a24-95ad-3fe9c7fa879d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.841627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1fd6e-e10f-4a24-95ad-3fe9c7fa879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.841916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1fd6e-e10f-4a24-95ad-3fe9c7fa879d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.842535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1fd6e-e10f-4a24-95ad-3fe9c7fa879d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.844164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1fd6e-e10f-4a24-95ad-3fe9c7fa879d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.855107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1262/2527] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:40.859071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:40.869144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350d40a-0c78-4919-994e-4cb1d9b9ab14 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:40.873597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:40.874226 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:40.874501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:40.874767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] PATH_INFO: `/v3/projects/922f369850964bf5a9eb1a381b2286f3/users/1909b47e4da2461a9cc4e5bcf8fcac05/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:40.889011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=922f369850964bf5a9eb1a381b2286f3, user_id=1909b47e4da2461a9cc4e5bcf8fcac05, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:40.891769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:40.990061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:40.996234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1266/2528] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:40 2022] PUT /identity/v3/projects/922f369850964bf5a9eb1a381b2286f3/users/1909b47e4da2461a9cc4e5bcf8fcac05/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:41.008487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.008844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.009134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.037472 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] MFA Rules not processed for user `1909b47e4da2461a9cc4e5bcf8fcac05`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:41.039376 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:41.088059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:41.106194 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1263/2529] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:41.110590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.172192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29857-64c6-4197-958b-313d7383de1c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:41.176842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:41.177474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.177752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.178021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.179177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:41.181175 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:41.278902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1267/2530] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:41 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:41.282860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.294331 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b838b-2684-4edc-8de7-a4decbcf8a4d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:41.349760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:41.350392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.351156 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.351428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.352155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:41.354277 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:41.447068 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1264/2531] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:41 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:41.448253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.458791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272a33-de7a-4622-9808-c8f5fa3356ac admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:41.463514 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:41.464115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.464657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.465565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.466211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:41.467809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:41.478812 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1268/2532] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:51:41.483491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.493739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564058-85c6-4f24-a7be-92fbeb8f389b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:41.498737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefef21-c0c9-4048-b531-cc1fbf759dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:41.499339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefef21-c0c9-4048-b531-cc1fbf759dde admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.499662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefef21-c0c9-4048-b531-cc1fbf759dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.499933 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefef21-c0c9-4048-b531-cc1fbf759dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.500567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefef21-c0c9-4048-b531-cc1fbf759dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:41.502187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefef21-c0c9-4048-b531-cc1fbf759dde admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:41.518212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1265/2533] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:41.519662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.532650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5a5d0-6d90-4244-b82b-604ad6b35386 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:41.540605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:41.541782 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.542250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.542800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] PATH_INFO: `/v3/projects/334f437d084d448fba600ed6143bd47e/users/aef96b74638e487ea407a5aabbb92050/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.568347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] RBAC: Authorizing `identity:create_grant(project_id=334f437d084d448fba600ed6143bd47e, user_id=aef96b74638e487ea407a5aabbb92050, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:41.571451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:41.638475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1269/2534] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:41 2022] PUT /identity/v3/projects/334f437d084d448fba600ed6143bd47e/users/aef96b74638e487ea407a5aabbb92050/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:41.648799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.649085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.650503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.678595 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] MFA Rules not processed for user `aef96b74638e487ea407a5aabbb92050`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:41.679717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:41.744791 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1266/2535] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:41.750150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.812304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409992a5-990d-4ebd-b432-bc03d119483c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:41.816873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:41.817495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:41.817773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:41.818041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:41.818663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:41.820582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:41.937927 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1270/2536] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:41 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:41.941922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:41.953422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d487-9614-48c3-8c48-8e4c23afe636 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.002891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:42.008657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.009295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.009573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.009838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.010454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.013111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.106135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1267/2537] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:41 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:42.110177 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:42.120772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c35e8-472f-4b84-bcfe-0547d6f79fa6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.126042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.126632 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.126913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.127186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.127970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.129628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.141201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1271/2538] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:42.149623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:42.159866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aa8d5-d680-4d79-ab99-ec79bf64c44f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.164422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.165046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.165358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.165632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] PATH_INFO: `/v3/projects/56ff57eda0db4599ad26835a40f0e116/users/f0edc271ded24f5f82a815ce66eae29b/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.181325 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ff57eda0db4599ad26835a40f0e116, user_id=f0edc271ded24f5f82a815ce66eae29b, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.184542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.285568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1268/2539] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:42 2022] PUT /identity/v3/projects/56ff57eda0db4599ad26835a40f0e116/users/f0edc271ded24f5f82a815ce66eae29b/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:42.289693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:42.300046 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6ff1-6310-4e91-91fa-72e28d0fa8c3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.320788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:42.360038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65528f-be97-4836-b970-45292a39f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.364849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65528f-be97-4836-b970-45292a39f727 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.364849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65528f-be97-4836-b970-45292a39f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.364849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65528f-be97-4836-b970-45292a39f727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.364849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65528f-be97-4836-b970-45292a39f727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.364849 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65528f-be97-4836-b970-45292a39f727 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.377834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1272/2540] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:42.379053 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:42.390612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb38700-aae9-45f0-8f6b-11bdad40d60e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.395270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.395908 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.396200 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.396468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] PATH_INFO: `/v3/projects/56ff57eda0db4599ad26835a40f0e116/users/f0edc271ded24f5f82a815ce66eae29b/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.398399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ff57eda0db4599ad26835a40f0e116, user_id=f0edc271ded24f5f82a815ce66eae29b, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.401032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.411559 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1269/2541] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:42 2022] PUT /identity/v3/projects/56ff57eda0db4599ad26835a40f0e116/users/f0edc271ded24f5f82a815ce66eae29b/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:42.422543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.422829 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.423122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.451706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] MFA Rules not processed for user `f0edc271ded24f5f82a815ce66eae29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:42.452923 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:42.490536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:42.493199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:42.523396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1273/2542] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:42.534135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:42.535466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:42.573225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698943c2-de27-4167-810d-5bcd4567f2ec admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.578993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.579591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.579867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.580131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.581873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:42.593459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cd74d-1859-4740-9a87-732d8eead04e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:42.595343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.596383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.598048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5cb0-bfd3-4f5c-b58a-f07b45216f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:42.598604 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5cb0-bfd3-4f5c-b58a-f07b45216f5b service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:42.598879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5cb0-bfd3-4f5c-b58a-f07b45216f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:42.599148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5cb0-bfd3-4f5c-b58a-f07b45216f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:42.609106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5cb0-bfd3-4f5c-b58a-f07b45216f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:42.610678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1270/2543] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:42.613710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef5cb0-bfd3-4f5c-b58a-f07b45216f5b service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:42.629300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1274/2544] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:51:43.834119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:43.834119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:43.844612 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ee669-4e87-4ff7-abd8-86660b1366fb service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:43.848185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:43.848776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:43.849084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:43.849377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:43.908012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:43.909494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:43.919303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1271/2545] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:44.183007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:44.188494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:44.188494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:44.202990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:44.204163 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:44.250535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:44.261733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1275/2546] 10.222.0.64 () {58 vars in 967 bytes} [Fri Sep 9 11:51:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:44.274603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:44.275998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:44.312676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:44.345893 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f76e11-c497-4bf5-899d-5a1aa4bc6744 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:44.351110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:44.351645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:44.351922 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:44.352214 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:44.361199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:44.362911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:44.371220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1272/2547] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:51:48.985732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:48.995055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144c0c1-f8e0-47a6-bad4-da3ebe2e21c4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:48.998624 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57890e-62db-4d7c-b06b-048a2f085d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:48.999218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57890e-62db-4d7c-b06b-048a2f085d65 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:48.999492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57890e-62db-4d7c-b06b-048a2f085d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:48.999757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57890e-62db-4d7c-b06b-048a2f085d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:49.057570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57890e-62db-4d7c-b06b-048a2f085d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:49.059020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57890e-62db-4d7c-b06b-048a2f085d65 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:49.067874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1276/2548] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:53.429979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:53.505886 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045163-609e-4fb3-b239-dc452d6aa91e service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:53.511410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:53.512113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:53.512394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:53.512672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] PATH_INFO: `/v3/users/1909b47e4da2461a9cc4e5bcf8fcac05` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:53.513833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1909b47e4da2461a9cc4e5bcf8fcac05)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:53.515772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:53.766245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1909b47e4da2461a9cc4e5bcf8fcac05'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:53.766953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1909b47e4da2461a9cc4e5bcf8fcac05'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:53.767815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1909b47e4da2461a9cc4e5bcf8fcac05'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:53.775774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1909b47e4da2461a9cc4e5bcf8fcac05'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:53.862097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2298da58-54ec-4883-9a38-f6378b237617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1909b47e4da2461a9cc4e5bcf8fcac05'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:53.880702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1273/2549] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:51:53 2022] DELETE /identity/v3/users/1909b47e4da2461a9cc4e5bcf8fcac05 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:53.885047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:53.885530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:53.885648 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:53.906370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:53.907622 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:53.907936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:53.908215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:53.909338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:53.928292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] MFA Rules not processed for user `5694e0c4dda94544bad91e5b9cb13b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:53.929994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:53.974152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:53.975753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1277/2550] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:53.985579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:53.987011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:53.992157 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1274/2551] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:51:54.047531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dd2df-4cd6-4d34-8e38-ee2c78f33e0e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:54.051590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:54.052189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:54.052871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:54.053144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:54.063499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:54.064977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:54.076571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1278/2552] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:51:54.382773 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:54.392921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c0ef6-d678-416a-9c5e-752982fb8ade None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:54.396314 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:54.396931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:54.397206 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:54.397501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:54.399196 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:54.408534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:54.409981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:54.419204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1275/2553] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:54.692586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:54.694082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:54.707676 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b276-6316-4bb3-80d1-0754e5eb378e service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:54.714262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:54.715091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:54.715542 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:54.715815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] PATH_INFO: `/v3/projects/922f369850964bf5a9eb1a381b2286f3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:54.716977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922f369850964bf5a9eb1a381b2286f3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:54.719378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:54.835650 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:54.861960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922f369850964bf5a9eb1a381b2286f3', 'request_id': 'req-4d074410-f94e-4f01-8029-caaa23388462'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:54.940366 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922f369850964bf5a9eb1a381b2286f3', 'request_id': 'req-4d074410-f94e-4f01-8029-caaa23388462'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:54.955477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922f369850964bf5a9eb1a381b2286f3', 'request_id': 'req-4d074410-f94e-4f01-8029-caaa23388462'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:54.970418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] The token cache is being invalidate because project 922f369850964bf5a9eb1a381b2286f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:51:54.970711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:54.971365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:54.972878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1279/2554] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:51:54 2022] DELETE /identity/v3/projects/922f369850964bf5a9eb1a381b2286f3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:54.978589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:54.991770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3287c-5f15-4fd3-b9cd-487589f30f75 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:55.052620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:55.053266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:55.053543 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:55.053811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] PATH_INFO: `/v3/users/aef96b74638e487ea407a5aabbb92050` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:55.054916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef96b74638e487ea407a5aabbb92050)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:55.056884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:55.343869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef96b74638e487ea407a5aabbb92050'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:55.344526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef96b74638e487ea407a5aabbb92050'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:55.345119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef96b74638e487ea407a5aabbb92050'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:55.352731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef96b74638e487ea407a5aabbb92050'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:55.431382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef96b74638e487ea407a5aabbb92050'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:55.451388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1276/2555] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:51:54 2022] DELETE /identity/v3/users/aef96b74638e487ea407a5aabbb92050 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:55.844631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:55.846179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:55.862022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d074410-f94e-4f01-8029-caaa23388462 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:55.922454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:55.923072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:55.923346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:55.923612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] PATH_INFO: `/v3/projects/334f437d084d448fba600ed6143bd47e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:55.924703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334f437d084d448fba600ed6143bd47e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:55.926655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:56.054349 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334f437d084d448fba600ed6143bd47e', 'request_id': 'req-7b221b67-1002-450d-925f-1b3c329fe0a6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.151402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334f437d084d448fba600ed6143bd47e', 'request_id': 'req-7b221b67-1002-450d-925f-1b3c329fe0a6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.157979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334f437d084d448fba600ed6143bd47e', 'request_id': 'req-7b221b67-1002-450d-925f-1b3c329fe0a6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.170094 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] The token cache is being invalidate because project 334f437d084d448fba600ed6143bd47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:51:56.170374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.171068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.172565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1280/2556] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:51:55 2022] DELETE /identity/v3/projects/334f437d084d448fba600ed6143bd47e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:51:56.176563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:56.177964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:56.191611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd162107-e43c-40a4-98d7-5cec1747d7c6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:56.239727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:56.249353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:56.249986 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:56.250263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:56.250536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] PATH_INFO: `/v3/users/f0edc271ded24f5f82a815ce66eae29b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:56.251676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0edc271ded24f5f82a815ce66eae29b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:56.253722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:56.550328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0edc271ded24f5f82a815ce66eae29b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.550907 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0edc271ded24f5f82a815ce66eae29b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.551513 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0edc271ded24f5f82a815ce66eae29b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.558688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0edc271ded24f5f82a815ce66eae29b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.654127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7b69be54-73f5-4c37-947c-2745e2414344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0edc271ded24f5f82a815ce66eae29b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:56.672204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1277/2557] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:51:56 2022] DELETE /identity/v3/users/f0edc271ded24f5f82a815ce66eae29b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:57.055711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:57.057376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:57.074459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b221b67-1002-450d-925f-1b3c329fe0a6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:57.129560 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:57.184115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:57.184751 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:57.185032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:57.185348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] PATH_INFO: `/v3/projects/56ff57eda0db4599ad26835a40f0e116` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:57.186504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ff57eda0db4599ad26835a40f0e116)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:57.188452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:57.323455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ff57eda0db4599ad26835a40f0e116', 'request_id': 'req-82745b30-e7bc-4bdb-9be6-001319ff6c21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:57.405373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ff57eda0db4599ad26835a40f0e116', 'request_id': 'req-82745b30-e7bc-4bdb-9be6-001319ff6c21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:57.411531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ff57eda0db4599ad26835a40f0e116', 'request_id': 'req-82745b30-e7bc-4bdb-9be6-001319ff6c21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:57.423795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] The token cache is being invalidate because project 56ff57eda0db4599ad26835a40f0e116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:51:57.424081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:57.424735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-82745b30-e7bc-4bdb-9be6-001319ff6c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:51:57.426253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1281/2558] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:51:57 2022] DELETE /identity/v3/projects/56ff57eda0db4599ad26835a40f0e116 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:57.432216 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:57.432731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:57.433084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:57.576364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:57.577546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:57.646215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1278/2559] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:57.655279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:57.655640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:57.655982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:57.676274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:57.677589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:57.686191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1282/2560] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:57.690347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:57.701089 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c453-cd3d-4bed-90a1-3f90fe909856 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:57.705854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:57.706471 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:57.706735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:57.707052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:57.707698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:51:57.707989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:57.709625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:57.723864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1279/2561] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:51:57.728286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:57.738657 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2772-7458-4df8-bedc-a170f0264d1e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:57.743962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:57.744598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:57.744875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:57.745703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:57.746427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:57.748347 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:57.864675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1283/2562] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:57 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:57.865991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:57.879501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055fc22-cee3-4541-bec8-77395df5f61a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:57.939223 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:57.939827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:57.940338 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:57.940772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:57.941445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:57.943361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:57.952150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:58.020205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1280/2563] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:57 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:58.021675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.032346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6fb63-dbff-465d-886f-f34b3bf63665 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.037164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.037874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.038222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.038561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.039263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.040977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.051119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1284/2564] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:58.058405 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.068478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f493698-0eb1-4d71-b31c-7cc6e2f15f6e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.075167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe7df0-c76e-4712-a69e-42dddb92d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.075802 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7df0-c76e-4712-a69e-42dddb92d334 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.076086 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7df0-c76e-4712-a69e-42dddb92d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.076358 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7df0-c76e-4712-a69e-42dddb92d334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.076997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe7df0-c76e-4712-a69e-42dddb92d334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.078639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe7df0-c76e-4712-a69e-42dddb92d334 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.089841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1281/2565] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:58.093834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.103993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79c578-b035-4616-bdc0-9549cc0c3d0c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.109354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.110101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.110376 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.110651 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] PATH_INFO: `/v3/projects/beafe6ac43014e96904febe64685ffbd/users/eff6efcd7576498d8f4e65b04e734b07/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.126719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beafe6ac43014e96904febe64685ffbd, user_id=eff6efcd7576498d8f4e65b04e734b07, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.129523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.254770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1285/2566] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:58 2022] PUT /identity/v3/projects/beafe6ac43014e96904febe64685ffbd/users/eff6efcd7576498d8f4e65b04e734b07/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:58.267028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.267028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.267028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.298668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] MFA Rules not processed for user `eff6efcd7576498d8f4e65b04e734b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:58.300033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:58.409446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1282/2567] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:58.414007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.528479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e364fe-93cb-40cf-a50e-83456de3cb42 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.538055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.541276 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.541649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.542027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.543264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.547380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.634921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:58.643133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1286/2568] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:51:58 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:58.647148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.659101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02a7d-1982-43d3-8505-bbd2ef3cdef4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.717026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.717664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.717937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.718201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.718836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.720737 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.829604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1283/2569] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:51:58 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:51:58.833708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.844815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecfc69-b888-4b62-a3db-07e2007b9bd4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.849556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.850247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.850528 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.850800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.851437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.853036 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.864156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1287/2570] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:58.868504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:58.878807 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84a3ce-7e72-4f8d-9431-8087f877b583 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:58.883346 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:58.884041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:58.884312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:58.886334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] PATH_INFO: `/v3/projects/d0c1da6a6e8d48f5849c3e3ae3ab7943/users/2faaaf0e89db43219a4fb5425f92aab7/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:58.900097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c1da6a6e8d48f5849c3e3ae3ab7943, user_id=2faaaf0e89db43219a4fb5425f92aab7, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:58.903382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:58.999497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1284/2571] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:58 2022] PUT /identity/v3/projects/d0c1da6a6e8d48f5849c3e3ae3ab7943/users/2faaaf0e89db43219a4fb5425f92aab7/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:59.003490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:59.015343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b19fb-6e83-4ecf-8c7d-d68ffed9353a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:59.074936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e09f1c-724c-499d-a4e9-2d1296315142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:59.074936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e09f1c-724c-499d-a4e9-2d1296315142 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:59.074936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e09f1c-724c-499d-a4e9-2d1296315142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:59.074936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e09f1c-724c-499d-a4e9-2d1296315142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:59.077706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e09f1c-724c-499d-a4e9-2d1296315142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:59.079056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e09f1c-724c-499d-a4e9-2d1296315142 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:59.092014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1288/2572] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:51:59.096140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:59.107602 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19910c00-94d0-4cb3-b9c1-91208d18e8cd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:59.113832 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:59.114484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:59.114748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:59.115054 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] PATH_INFO: `/v3/projects/d0c1da6a6e8d48f5849c3e3ae3ab7943/users/2faaaf0e89db43219a4fb5425f92aab7/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:59.116935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c1da6a6e8d48f5849c3e3ae3ab7943, user_id=2faaaf0e89db43219a4fb5425f92aab7, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:59.119655 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:59.130991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1285/2573] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:51:59 2022] PUT /identity/v3/projects/d0c1da6a6e8d48f5849c3e3ae3ab7943/users/2faaaf0e89db43219a4fb5425f92aab7/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:51:59.142314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:59.142795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:59.142926 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:59.172425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] MFA Rules not processed for user `2faaaf0e89db43219a4fb5425f92aab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:51:59.173680 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:59.244160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1289/2574] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:51:59.255665 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:59.257416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:51:59.280545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:51:59.316278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b965-4b24-4db2-9807-1993946dae84 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:59.319881 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:59.320476 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:59.320778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:59.321044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:59.332051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:59.333827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:59.347536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1286/2575] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:51:59.469752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:51:59.479557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5320ef-c17e-4219-8700-784c5b8e14e9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:51:59.483531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887e76-e787-4f45-9ca8-4f38ff685cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:51:59.484127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887e76-e787-4f45-9ca8-4f38ff685cbd service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:51:59.484406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887e76-e787-4f45-9ca8-4f38ff685cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:51:59.484677 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887e76-e787-4f45-9ca8-4f38ff685cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:51:59.544383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887e76-e787-4f45-9ca8-4f38ff685cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:51:59.546026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887e76-e787-4f45-9ca8-4f38ff685cbd service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:51:59.556619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1290/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:02.707062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:02.772517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f16d8-a413-4ef3-acf3-93e3a4472cb3 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:02.777135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:02.777801 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:02.778133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:02.778347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] PATH_INFO: `/v3/users/eff6efcd7576498d8f4e65b04e734b07` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:02.779461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff6efcd7576498d8f4e65b04e734b07)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:02.781418 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:02.977916 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff6efcd7576498d8f4e65b04e734b07'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:02.978568 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff6efcd7576498d8f4e65b04e734b07'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:02.980523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff6efcd7576498d8f4e65b04e734b07'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:02.987748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff6efcd7576498d8f4e65b04e734b07'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:03.066024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff6efcd7576498d8f4e65b04e734b07'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:03.094340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1287/2577] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:02 2022] DELETE /identity/v3/users/eff6efcd7576498d8f4e65b04e734b07 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:03.098936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:03.099495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:03.099495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:03.133186 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:03.134649 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:03.140263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:03.217026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1291/2578] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:03.229381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:03.229381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:03.281060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:03.296530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c19651-b30f-4371-a775-ea5b6c1d1b89 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:03.300402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:03.301042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:03.302738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:03.302738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:03.311364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:03.315232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:03.322316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1288/2579] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:03.806289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:03.807700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:03.820580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafc0cf-0a2c-4f95-98d0-1eaaf6e5abd6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:03.826496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:03.826887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:03.827242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:03.827426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] PATH_INFO: `/v3/projects/beafe6ac43014e96904febe64685ffbd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:03.828816 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beafe6ac43014e96904febe64685ffbd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:03.831265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:03.968986 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beafe6ac43014e96904febe64685ffbd', 'request_id': 'req-e9d9fe0c-156d-465d-82cb-affa7ad0e795'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.048272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beafe6ac43014e96904febe64685ffbd', 'request_id': 'req-e9d9fe0c-156d-465d-82cb-affa7ad0e795'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.054288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beafe6ac43014e96904febe64685ffbd', 'request_id': 'req-e9d9fe0c-156d-465d-82cb-affa7ad0e795'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.066427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] The token cache is being invalidate because project beafe6ac43014e96904febe64685ffbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:04.066716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.067357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.069247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1292/2580] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:03 2022] DELETE /identity/v3/projects/beafe6ac43014e96904febe64685ffbd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:04.072977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:04.084497 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c283ec-194e-4ed6-b020-bc11f9ad830d service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:04.145152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:04.145984 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:04.146353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:04.150534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] PATH_INFO: `/v3/users/2faaaf0e89db43219a4fb5425f92aab7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:04.150534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2faaaf0e89db43219a4fb5425f92aab7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:04.150534 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:04.346901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2faaaf0e89db43219a4fb5425f92aab7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.347573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2faaaf0e89db43219a4fb5425f92aab7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.348172 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2faaaf0e89db43219a4fb5425f92aab7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.356507 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2faaaf0e89db43219a4fb5425f92aab7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.447979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddbeb2ea-9ce8-4323-a4f9-4a8aabc6f7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2faaaf0e89db43219a4fb5425f92aab7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:04.469183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1289/2581] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:04 2022] DELETE /identity/v3/users/2faaaf0e89db43219a4fb5425f92aab7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:04.918671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:04.921078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:04.941628 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9fe0c-156d-465d-82cb-affa7ad0e795 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.023123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.023759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.024178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.024505 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] PATH_INFO: `/v3/projects/d0c1da6a6e8d48f5849c3e3ae3ab7943` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.025898 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c1da6a6e8d48f5849c3e3ae3ab7943)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.027783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.158072 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:05.168374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c1da6a6e8d48f5849c3e3ae3ab7943', 'request_id': 'req-a008714a-dc26-421b-b788-a21a87ce2a67'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:05.254553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c1da6a6e8d48f5849c3e3ae3ab7943', 'request_id': 'req-a008714a-dc26-421b-b788-a21a87ce2a67'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:05.262579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c1da6a6e8d48f5849c3e3ae3ab7943', 'request_id': 'req-a008714a-dc26-421b-b788-a21a87ce2a67'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:05.273443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] The token cache is being invalidate because project d0c1da6a6e8d48f5849c3e3ae3ab7943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:05.273726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:05.274390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a008714a-dc26-421b-b788-a21a87ce2a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:05.275857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1293/2582] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:04 2022] DELETE /identity/v3/projects/d0c1da6a6e8d48f5849c3e3ae3ab7943 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:05.281350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.281862 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.281993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.300987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:05.302246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:05.363356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1290/2583] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:05.370596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.370944 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.371229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.395353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:05.396956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:05.405612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1294/2584] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:05.410040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:05.417249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:05.421431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c2365-81d4-4be1-b202-8d19f0dfc0ca None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.426316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.431641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.431641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.431641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.431641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:05.431641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.431641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.444106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1291/2585] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:52:05.448796 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:05.461452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b6b3a-e1d9-4a35-8428-1ab3d46a05c5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.467452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.468130 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.468603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.468941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.469694 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.471705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.606201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1295/2586] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:05 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:05.611295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:05.621433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014bf9-ab6b-4254-99af-ef5e897fb677 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.681046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.681677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.681965 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.682230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.682855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.684754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.751048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1292/2587] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:05 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:05.755214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:05.765583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c712d-8f08-48ea-b8b3-e07622d2d2b4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.770208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.770798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.771083 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.771356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.771989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.773681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.784691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1296/2588] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:05.788654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:05.799560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed84dc-dc2e-4f0a-ab25-80e8c073e0e1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.804101 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f3cf8-1bcd-4517-af06-24f3dea42485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.804687 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3cf8-1bcd-4517-af06-24f3dea42485 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.804964 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3cf8-1bcd-4517-af06-24f3dea42485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.805256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3cf8-1bcd-4517-af06-24f3dea42485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.805889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f3cf8-1bcd-4517-af06-24f3dea42485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.807470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f3cf8-1bcd-4517-af06-24f3dea42485 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.819110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1293/2589] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:52:05.823279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:05.833890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e032d-8861-4c21-8f35-afa293084c78 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:05.838637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:05.839543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.839813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.840078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] PATH_INFO: `/v3/projects/781babf021044d079dfd119bf26ea01f/users/7f05c9cd2ad24eefab7e9042c5a4c6f7/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.854861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781babf021044d079dfd119bf26ea01f, user_id=7f05c9cd2ad24eefab7e9042c5a4c6f7, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:05.858127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:05.939416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1297/2590] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:05 2022] PUT /identity/v3/projects/781babf021044d079dfd119bf26ea01f/users/7f05c9cd2ad24eefab7e9042c5a4c6f7/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:05.950820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:05.951648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:05.952657 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:05.980696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] MFA Rules not processed for user `7f05c9cd2ad24eefab7e9042c5a4c6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:05.981935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:06.048142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1294/2591] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:06.053100 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.119912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8459c2a-c26b-4046-b062-99414e2742d1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.124985 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.127148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.127148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.127148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.127148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.128822 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:06.240156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1298/2592] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:06 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:06.244145 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.254896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903099e8-6f96-420f-8931-33734c0959a8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.313290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.314090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.314370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.314641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.315356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.317345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:06.325380 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:06.416853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1295/2593] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:06 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:06.420883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.431161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090114-6779-4db9-ba11-c852ea98e668 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.436319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.436904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.437181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.437474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.438095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.439696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:06.450029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1299/2594] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:06.454647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.464760 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cabcca-0e5c-4ae2-af1c-b4b88e278ece admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.469498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.470170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.470442 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.470711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] PATH_INFO: `/v3/projects/b858645d520f407ba02906b6539f1531/users/a735bef5eeba4462902fa133a821162e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.486817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b858645d520f407ba02906b6539f1531, user_id=a735bef5eeba4462902fa133a821162e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.489516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:06.604709 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1296/2595] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:06 2022] PUT /identity/v3/projects/b858645d520f407ba02906b6539f1531/users/a735bef5eeba4462902fa133a821162e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:06.608767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.619371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eff661-da41-4a17-8378-2f17aa222dd2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.655012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:06.684463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa1b7-4d45-474b-8601-274c45f599ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.685244 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa1b7-4d45-474b-8601-274c45f599ce admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.686193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa1b7-4d45-474b-8601-274c45f599ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.686593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa1b7-4d45-474b-8601-274c45f599ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.687451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa1b7-4d45-474b-8601-274c45f599ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.689370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa1b7-4d45-474b-8601-274c45f599ce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:06.701794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1300/2596] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:06.705685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.719877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730261-9d7a-4816-b092-cba305e04450 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.730694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.731360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.731641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.731913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] PATH_INFO: `/v3/projects/b858645d520f407ba02906b6539f1531/users/a735bef5eeba4462902fa133a821162e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.735155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b858645d520f407ba02906b6539f1531, user_id=a735bef5eeba4462902fa133a821162e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.737981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:06.750345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1297/2597] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:06 2022] PUT /identity/v3/projects/b858645d520f407ba02906b6539f1531/users/a735bef5eeba4462902fa133a821162e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:06.775198 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.775661 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.775945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.807588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] MFA Rules not processed for user `a735bef5eeba4462902fa133a821162e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:06.809176 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:06.896005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1301/2598] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:06.908281 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:06.910108 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:06.977158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84197a8-c614-4083-b944-4b0049b9e69a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:06.981078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:06.981719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:06.981995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:06.982951 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:06.992782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:06.994898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:07.005798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1298/2599] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:07.268307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:07.281077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ba609-b339-425a-bf4f-612ab7ed3058 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:07.285354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85fb5-bb16-4205-8333-3b8019365913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:07.286325 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85fb5-bb16-4205-8333-3b8019365913 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:07.286859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85fb5-bb16-4205-8333-3b8019365913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:07.287313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85fb5-bb16-4205-8333-3b8019365913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:07.362256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85fb5-bb16-4205-8333-3b8019365913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:07.363740 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85fb5-bb16-4205-8333-3b8019365913 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:07.375579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1302/2600] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:13.933297 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:13.995203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f2a3f-f141-434f-b18e-555b799277ca service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:13.999993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:14.000603 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:14.000877 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:14.001141 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] PATH_INFO: `/v3/users/7f05c9cd2ad24eefab7e9042c5a4c6f7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:14.002269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f05c9cd2ad24eefab7e9042c5a4c6f7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:14.004153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:14.241031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f05c9cd2ad24eefab7e9042c5a4c6f7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:14.241794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f05c9cd2ad24eefab7e9042c5a4c6f7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:14.242401 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f05c9cd2ad24eefab7e9042c5a4c6f7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:14.249626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f05c9cd2ad24eefab7e9042c5a4c6f7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:14.251260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:14.315940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f05c9cd2ad24eefab7e9042c5a4c6f7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:14.333710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1299/2601] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:13 2022] DELETE /identity/v3/users/7f05c9cd2ad24eefab7e9042c5a4c6f7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:14.338402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:14.339427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:14.339718 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:14.358955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:14.360134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:14.406943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:14.419261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1303/2602] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:14.429139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:14.430641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:14.489647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e335d-9f70-448b-8613-d29a03b60f98 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:14.493270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:14.493882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:14.494159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:14.494425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:14.505861 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:14.507403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:14.518803 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1300/2603] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:14.960888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:14.962371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:14.978444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c00e-79af-440b-ab85-fbb80500fcb7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:14.983665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:14.984340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:14.984622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:14.984896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] PATH_INFO: `/v3/projects/781babf021044d079dfd119bf26ea01f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:14.986082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=781babf021044d079dfd119bf26ea01f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:14.988021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:15.147837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781babf021044d079dfd119bf26ea01f', 'request_id': 'req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.250211 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781babf021044d079dfd119bf26ea01f', 'request_id': 'req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.256708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781babf021044d079dfd119bf26ea01f', 'request_id': 'req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.268802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] The token cache is being invalidate because project 781babf021044d079dfd119bf26ea01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:15.269091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.269774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.271296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1304/2604] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:14 2022] DELETE /identity/v3/projects/781babf021044d079dfd119bf26ea01f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:15.275452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:15.285565 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16bf08-065e-4dd5-9f1b-6cedc33ade2b service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:15.346935 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:15.347567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:15.347850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:15.348125 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] PATH_INFO: `/v3/users/a735bef5eeba4462902fa133a821162e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:15.349271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a735bef5eeba4462902fa133a821162e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:15.351222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:15.597906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a735bef5eeba4462902fa133a821162e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.598629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a735bef5eeba4462902fa133a821162e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.599342 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a735bef5eeba4462902fa133a821162e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.609400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a735bef5eeba4462902fa133a821162e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.733589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-54220509-c1dc-4ddc-83a7-d36dfea57c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a735bef5eeba4462902fa133a821162e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:15.746152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:15.753343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1301/2605] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:15 2022] DELETE /identity/v3/users/a735bef5eeba4462902fa133a821162e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:16.143075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:16.144567 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:16.161049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9ed44-81b1-4842-91dd-ca5c065d5c9e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:16.220474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:16.221093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.221403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.221682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] PATH_INFO: `/v3/projects/b858645d520f407ba02906b6539f1531` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.222809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b858645d520f407ba02906b6539f1531)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:16.224724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:16.375900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b858645d520f407ba02906b6539f1531', 'request_id': 'req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:16.458791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b858645d520f407ba02906b6539f1531', 'request_id': 'req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:16.465057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b858645d520f407ba02906b6539f1531', 'request_id': 'req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:16.477088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] The token cache is being invalidate because project b858645d520f407ba02906b6539f1531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:16.477456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:16.478107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f3e0a10a-dbc3-4893-914a-31fc142d3fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:16.479574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1305/2606] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:16 2022] DELETE /identity/v3/projects/b858645d520f407ba02906b6539f1531 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:16.486396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.486895 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.487055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.507100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:16.508288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:16.565517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1302/2607] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:52:16.573452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.581921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.581921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.588146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:16.593963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:16.595148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:16.602800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1306/2608] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:16.607567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:16.617139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3544ee2-1d96-4153-8f79-e7f697451c0a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:16.621627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:16.622218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.623091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.623576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.624328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:16.624620 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:16.626275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:16.639966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1303/2609] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:52:16.645032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:16.653570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc4b31-dc79-466b-8a59-7e7d609c07e1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:16.658353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:16.659122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.659826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.660091 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.660719 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:16.662655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:16.764689 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1307/2610] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:16 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:16.768868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:16.778675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da0b20-a1b8-412f-a9af-f6673f21b967 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:16.839248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:16.839853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.840127 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.840391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.841535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:16.843454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:16.930421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1304/2611] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:16 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:16.935126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:16.946009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72933416-334e-4648-b9e2-0ea582504bf6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:16.950752 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:16.956295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.956295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.956295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.956295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:16.956295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:16.964570 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1308/2612] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:16.969351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:16.979455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116598-7a70-4656-9b70-5c9d82ff63ab admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:16.984797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc00e4-67d1-4ce4-a6a5-f546e16f8d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:16.985464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc00e4-67d1-4ce4-a6a5-f546e16f8d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:16.985740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc00e4-67d1-4ce4-a6a5-f546e16f8d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:16.986004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc00e4-67d1-4ce4-a6a5-f546e16f8d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:16.986634 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc00e4-67d1-4ce4-a6a5-f546e16f8d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:16.988191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc00e4-67d1-4ce4-a6a5-f546e16f8d37 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:16.999047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1305/2613] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:17.003074 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.013014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bad47-5d0e-44fc-b373-d55158b5ddca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.017768 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.018407 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.018684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.018953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] PATH_INFO: `/v3/projects/8d6e247563ad43b39517f77437afce92/users/94fe41ef99754c7c822496a7676b3fce/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.034120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6e247563ad43b39517f77437afce92, user_id=94fe41ef99754c7c822496a7676b3fce, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.036856 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.135453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1309/2614] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:17 2022] PUT /identity/v3/projects/8d6e247563ad43b39517f77437afce92/users/94fe41ef99754c7c822496a7676b3fce/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:17.146921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.147290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.147573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.184707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] MFA Rules not processed for user `94fe41ef99754c7c822496a7676b3fce`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:17.186804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:17.242523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:17.259359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1306/2615] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:17.264866 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.327761 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb9eb-109e-47d5-9747-057f6d67a239 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.332364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.332960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.333261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.333536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.334154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.336055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.428566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1310/2616] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:17.432677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.443319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55c3c-b08e-443f-bba8-55821f1f1809 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.500467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.501105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.501357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.501626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.502247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.504129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.587475 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1307/2617] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:17 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:17.592250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.602601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6345e28-3dc7-42e5-a8ea-0b35e4ebc33c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.607561 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.608150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.608429 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.608706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.609368 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.611011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.629162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1311/2618] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:17.633734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.644549 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d6dbb-4582-4275-91ad-f1872acb1aa5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.649604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.650248 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.650522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.650784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] PATH_INFO: `/v3/projects/0743a232dca5410299fb2dfc1d0374f1/users/db8d07058e27441983fe1d3e0a736f32/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.665614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0743a232dca5410299fb2dfc1d0374f1, user_id=db8d07058e27441983fe1d3e0a736f32, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.668350 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.764841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1308/2619] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:17 2022] PUT /identity/v3/projects/0743a232dca5410299fb2dfc1d0374f1/users/db8d07058e27441983fe1d3e0a736f32/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:17.768811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.778885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c56adb-2b92-4efe-ba1d-30c7d66a2828 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.834578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4edc-ca2e-4ed0-97ec-e14c849756cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.835166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4edc-ca2e-4ed0-97ec-e14c849756cc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.835443 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4edc-ca2e-4ed0-97ec-e14c849756cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.835804 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4edc-ca2e-4ed0-97ec-e14c849756cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.836315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4edc-ca2e-4ed0-97ec-e14c849756cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.837942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4edc-ca2e-4ed0-97ec-e14c849756cc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.850302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1312/2620] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:17.854503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:17.864690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd2db-b9e5-42a9-bc41-2fa02586e290 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:17.869349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:17.869988 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.870263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.870528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] PATH_INFO: `/v3/projects/0743a232dca5410299fb2dfc1d0374f1/users/db8d07058e27441983fe1d3e0a736f32/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.872926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0743a232dca5410299fb2dfc1d0374f1, user_id=db8d07058e27441983fe1d3e0a736f32, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:17.875581 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:17.890271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1309/2621] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:17 2022] PUT /identity/v3/projects/0743a232dca5410299fb2dfc1d0374f1/users/db8d07058e27441983fe1d3e0a736f32/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:17.903344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:17.903709 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:17.904166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:17.932461 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:17.936009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] MFA Rules not processed for user `db8d07058e27441983fe1d3e0a736f32`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:17.937271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:18.006612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1313/2622] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:18.018178 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:18.020259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:18.080115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3373f-5822-4059-8d9b-b55034165f64 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:18.083763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:18.084357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:18.084648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:18.084940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:18.143444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:18.144873 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:18.148701 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:18.155220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1310/2623] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:23.569511 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:23.571018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:23.584669 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5ec7-69c4-4c07-bd83-11a1b1c94bbc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:23.588292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:23.589155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:23.589460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:23.589731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:23.599857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:23.605082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:23.612090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1314/2624] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:28.224349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:28.553121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:28.554547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:28.613412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cd209-03d5-4fdf-b3f1-5fdb39ca07fe service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:28.617090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:28.617731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:28.618014 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:28.618289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:28.620044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:28.686470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:28.688074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2914-d045-465b-851f-82d7fc36bbe0 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:28.698169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1311/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:29.536815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:29.547679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2199-6e22-4b2e-ad9b-f81de2cf9241 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:29.552419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:29.553030 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:29.553340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:29.553608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] PATH_INFO: `/v3/users/94fe41ef99754c7c822496a7676b3fce` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:29.554707 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fe41ef99754c7c822496a7676b3fce)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:29.556615 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:29.832614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fe41ef99754c7c822496a7676b3fce'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:29.833185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fe41ef99754c7c822496a7676b3fce'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:29.910289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fe41ef99754c7c822496a7676b3fce'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:29.919022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fe41ef99754c7c822496a7676b3fce'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:29.920658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fe41ef99754c7c822496a7676b3fce'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:29.947912 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1315/2626] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:29 2022] DELETE /identity/v3/users/94fe41ef99754c7c822496a7676b3fce => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:29.959707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834e2b-355a-4532-9da4-a144e283894a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:29.960344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834e2b-355a-4532-9da4-a144e283894a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:29.960344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834e2b-355a-4532-9da4-a144e283894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:29.987238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-62834e2b-355a-4532-9da4-a144e283894a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:29.988747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-62834e2b-355a-4532-9da4-a144e283894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:30.056743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1312/2627] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:30.066787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:30.068365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:30.135452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0bf3f-2c5f-4554-83e1-e06e697bd6a6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:30.139045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:30.139808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:30.140103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:30.140490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:30.150111 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:30.151521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:30.157447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:30.162530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1316/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:30.589307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834e2b-355a-4532-9da4-a144e283894a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:30.592521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-62834e2b-355a-4532-9da4-a144e283894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:30.620702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834e2b-355a-4532-9da4-a144e283894a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:30.632868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:30.633548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:30.633846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:30.637998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] PATH_INFO: `/v3/projects/8d6e247563ad43b39517f77437afce92` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:30.637998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6e247563ad43b39517f77437afce92)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:30.637998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:30.727058 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:30.730435 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6e247563ad43b39517f77437afce92', 'request_id': 'req-95baf0d1-92db-41cd-a085-f7b119c5f732'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:30.737402 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6e247563ad43b39517f77437afce92', 'request_id': 'req-95baf0d1-92db-41cd-a085-f7b119c5f732'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:30.808947 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6e247563ad43b39517f77437afce92', 'request_id': 'req-95baf0d1-92db-41cd-a085-f7b119c5f732'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:30.821771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] The token cache is being invalidate because project 8d6e247563ad43b39517f77437afce92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:30.822185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:30.823010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:30.825252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1313/2629] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:30 2022] DELETE /identity/v3/projects/8d6e247563ad43b39517f77437afce92 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:30.829469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:30.840017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8658f72-d778-4709-9745-7c4ffae20005 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:30.900459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:30.901086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:30.901409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:30.901705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] PATH_INFO: `/v3/users/db8d07058e27441983fe1d3e0a736f32` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:30.902824 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8d07058e27441983fe1d3e0a736f32)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:30.905005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:31.095090 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8d07058e27441983fe1d3e0a736f32'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:31.095871 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8d07058e27441983fe1d3e0a736f32'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:31.169009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8d07058e27441983fe1d3e0a736f32'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:31.176706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8d07058e27441983fe1d3e0a736f32'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:31.177432 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-260befb6-3c2b-4f33-b6fa-4930e7e90965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8d07058e27441983fe1d3e0a736f32'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:31.194972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1317/2630] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:30 2022] DELETE /identity/v3/users/db8d07058e27441983fe1d3e0a736f32 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:31.784219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:31.785420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:31.800082 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf0d1-92db-41cd-a085-f7b119c5f732 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:31.873186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:31.873920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:31.874292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:31.874459 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] PATH_INFO: `/v3/projects/0743a232dca5410299fb2dfc1d0374f1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:31.875864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0743a232dca5410299fb2dfc1d0374f1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:31.877792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.003625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0743a232dca5410299fb2dfc1d0374f1', 'request_id': 'req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.011379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0743a232dca5410299fb2dfc1d0374f1', 'request_id': 'req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.089432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0743a232dca5410299fb2dfc1d0374f1', 'request_id': 'req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.105723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] The token cache is being invalidate because project 0743a232dca5410299fb2dfc1d0374f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:32.106144 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.106752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c0a8f07b-e8d4-4215-a2ca-fdb8f97cb7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.108484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1314/2631] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:31 2022] DELETE /identity/v3/projects/0743a232dca5410299fb2dfc1d0374f1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:32.114272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.114858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.114858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.137435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:32.142289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:32.206539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1318/2632] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:32.215425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.215642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.215859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.236814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:32.237956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:32.249117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1315/2633] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:32.251051 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.262128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c958d1e-c7e7-4ea6-8300-54a1bced116f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.267758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.268373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.268654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.268942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.269618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:32.269922 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.271806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.294399 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1319/2634] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:52:32.296282 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.307590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cc595-6034-4f18-b3dd-874c35e7a10b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.314201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.314851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.315128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.315398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.316312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.326036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.433694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1316/2635] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:32 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:32.442981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.452905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd9ce-a079-4270-9ac5-463224f65355 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.457605 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:32.514043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.514915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.515038 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.515255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.516617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.518693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.568652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.570465 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:32.621283 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:32.626786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1320/2636] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:32 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:32.628197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.638880 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6207f3-90e1-499c-bf7f-1956bf1c5229 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.645553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.646237 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.649858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.649858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.649858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.650171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b671f1f-fe06-4586-8513-01e6e1690732 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.650273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.653809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.654416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.654736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.655006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.657175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:32.660848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1321/2637] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:52:32.664774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.671474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.673878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.676240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e118-1a2d-4137-a902-a62e050fdeb5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.680876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.681496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.681769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.682031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.682652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.684247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.693327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1317/2638] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:52:32.696143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1322/2639] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:52:32.700840 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.715587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bba2b8-dbef-4099-9f6c-c47aaf6b0904 service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.722218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2004-e888-4449-b527-433f02168116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.722880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2004-e888-4449-b527-433f02168116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.723160 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2004-e888-4449-b527-433f02168116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.723430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2004-e888-4449-b527-433f02168116 admin admin] PATH_INFO: `/v3/projects/0171dabbcede44a4af5cb56acec79b11/users/7ea53f8d503742f395782dd2e77ed99a/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.734135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:32.734135 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:32.743191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d2004-e888-4449-b527-433f02168116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0171dabbcede44a4af5cb56acec79b11, user_id=7ea53f8d503742f395782dd2e77ed99a, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.746254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d2004-e888-4449-b527-433f02168116 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.746477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769710-c469-4302-9484-3c30aa4a64d3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:32.752776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:32.753367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.753754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.753982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] PATH_INFO: `/v3/users/61ed413fdfab427287e7355612a795b3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.755096 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ed413fdfab427287e7355612a795b3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:32.757070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:32.826318 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1318/2640] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:32 2022] PUT /identity/v3/projects/0171dabbcede44a4af5cb56acec79b11/users/7ea53f8d503742f395782dd2e77ed99a/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:52:32.895122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:32.895404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:32.895670 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:32.924741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] MFA Rules not processed for user `7ea53f8d503742f395782dd2e77ed99a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:32.926015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:32.932197 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ed413fdfab427287e7355612a795b3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.932883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ed413fdfab427287e7355612a795b3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.995810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ed413fdfab427287e7355612a795b3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:32.996446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1319/2641] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:52:33.004717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ed413fdfab427287e7355612a795b3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.005404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ed413fdfab427287e7355612a795b3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.008643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:33.010134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.025879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1323/2642] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:32 2022] DELETE /identity/v3/users/61ed413fdfab427287e7355612a795b3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:52:33.069868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858cca-f67a-44a7-b2bb-94d965f77201 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:33.115854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:33.121611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:33.122220 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.122500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.122771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.124510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.185997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:33.187519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:33.197188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1320/2643] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:33.225300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:33.230595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.285049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:33.301692 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:33.303328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.305247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471935e-ad98-422f-a8e0-7444828d3a53 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:33.310728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:33.311467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.311838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.312204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] PATH_INFO: `/v3/users/7ea53f8d503742f395782dd2e77ed99a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.316138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea53f8d503742f395782dd2e77ed99a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:33.318970 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:33.338563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83825299-fddb-4c81-9383-a350440a1e70 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:33.352386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:33.353646 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.354069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.354484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] PATH_INFO: `/v3/projects/0b282e64596f4ef8b8993f5dfcf37932` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.356715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b282e64596f4ef8b8993f5dfcf37932)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:33.359926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:33.547964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea53f8d503742f395782dd2e77ed99a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.548313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b282e64596f4ef8b8993f5dfcf37932', 'request_id': 'req-49b09842-95c3-4734-bf5c-7fb21c85b02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.548565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea53f8d503742f395782dd2e77ed99a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.554553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b282e64596f4ef8b8993f5dfcf37932', 'request_id': 'req-49b09842-95c3-4734-bf5c-7fb21c85b02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.629902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea53f8d503742f395782dd2e77ed99a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.637857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea53f8d503742f395782dd2e77ed99a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.640727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e1ed5cc2-cdbf-4683-9276-258d6197e5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea53f8d503742f395782dd2e77ed99a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.657813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1324/2644] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:33 2022] DELETE /identity/v3/users/7ea53f8d503742f395782dd2e77ed99a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:33.662166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.662497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.662777 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.683679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:33.685021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.688929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b282e64596f4ef8b8993f5dfcf37932', 'request_id': 'req-49b09842-95c3-4734-bf5c-7fb21c85b02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.701628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] The token cache is being invalidate because project 0b282e64596f4ef8b8993f5dfcf37932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:33.701927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.702584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49b09842-95c3-4734-bf5c-7fb21c85b02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:33.705266 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1321/2645] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:33 2022] DELETE /identity/v3/projects/0b282e64596f4ef8b8993f5dfcf37932 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:33.710050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aad36-1efb-4dae-925c-8e1f38f84088 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.710328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aad36-1efb-4dae-925c-8e1f38f84088 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.710661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aad36-1efb-4dae-925c-8e1f38f84088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.735222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5d2aad36-1efb-4dae-925c-8e1f38f84088 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:33.736519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5d2aad36-1efb-4dae-925c-8e1f38f84088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.761062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1325/2646] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:52:33.771092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:33.772645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.806858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1322/2647] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:52:33.815031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.815312 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.815578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.832616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285222e2-858a-4dc0-9929-36fafca20342 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:33.834579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:33.835756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:33.836805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:33.837512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.837862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.838136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.844823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1323/2648] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:52:33.848419 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:33.848923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:33.849937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:33.857728 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd2aa1-ada7-4cc5-afce-505ba2bf10d9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:33.859469 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1326/2649] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:52:33.863628 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:33.864241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.864518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.864900 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.865579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:33.865878 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:33.867486 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:33.879653 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1324/2650] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:52:33.883874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:33.893577 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff1dd-69a2-4bb8-8792-9a139ffb4f94 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:33.898352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:33.898947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:33.899226 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:33.899497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:33.900126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:33.902075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:33.908031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:34.059974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1327/2651] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:33 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:34.063894 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.070356 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:34.074438 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a298-c1da-4567-aba0-80c654ccc525 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.139321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.140062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.140348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.141337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.141936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.144400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.232296 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1325/2652] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:34 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:34.236546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.247004 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98c3e-c80a-49a2-b1eb-3842eaecdc9f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.251672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.258456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.258456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.258456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.258456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.258456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.264899 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1328/2653] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:34.269502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.279326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1bb21-a2c1-44dd-8b03-ebbdcd0c7690 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.285120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.285738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.286010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.286275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.286899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.288503 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.299139 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1326/2654] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:52:34.303245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.313118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f87fe9-d6ab-45e3-8224-8dff6fb06970 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.317989 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0a56a-1999-4322-ac38-72cbd275e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.318637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0a56a-1999-4322-ac38-72cbd275e285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.318921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0a56a-1999-4322-ac38-72cbd275e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.319181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0a56a-1999-4322-ac38-72cbd275e285 admin admin] PATH_INFO: `/v3/projects/6a61369d132c4871be75f56bab740ef1/users/09b2c20708ba4a5a89732d7d8cc6ac6a/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.330771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.332981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:34.338574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0a56a-1999-4322-ac38-72cbd275e285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a61369d132c4871be75f56bab740ef1, user_id=09b2c20708ba4a5a89732d7d8cc6ac6a, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.341442 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0a56a-1999-4322-ac38-72cbd275e285 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.348391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c7c9a-af71-49b7-bf16-7d8389de3913 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.353707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.360393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.360393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.360393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] PATH_INFO: `/v3/projects/0171dabbcede44a4af5cb56acec79b11` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.360393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0171dabbcede44a4af5cb56acec79b11)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.360393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.420341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1329/2655] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:34 2022] PUT /identity/v3/projects/6a61369d132c4871be75f56bab740ef1/users/09b2c20708ba4a5a89732d7d8cc6ac6a/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:34.430601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.430884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.431154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.460304 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] MFA Rules not processed for user `09b2c20708ba4a5a89732d7d8cc6ac6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:34.461531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:34.473899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0171dabbcede44a4af5cb56acec79b11', 'request_id': 'req-0328a321-21f4-46e6-b779-566d303f4062'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:34.479829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0171dabbcede44a4af5cb56acec79b11', 'request_id': 'req-0328a321-21f4-46e6-b779-566d303f4062'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:34.526884 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1330/2656] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:52:34.531503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.557322 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0171dabbcede44a4af5cb56acec79b11', 'request_id': 'req-0328a321-21f4-46e6-b779-566d303f4062'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:34.570271 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] The token cache is being invalidate because project 0171dabbcede44a4af5cb56acec79b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:34.570483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:34.571135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:34.572625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1327/2657] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:34 2022] DELETE /identity/v3/projects/0171dabbcede44a4af5cb56acec79b11 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:52:34.606426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95761e05-1606-4986-a333-f6ce1208fb4e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.616862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.617741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.618119 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.618398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.619117 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.621204 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.721014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1331/2658] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:34.725647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.727170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:34.741148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a321-21f4-46e6-b779-566d303f4062 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.805084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.805727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.806003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.806270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.806904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.808829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.821239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:34.905990 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1328/2659] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:34 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:34.910294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.920492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9e7e-6026-4384-9321-936bedf2f87a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.926123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.926702 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.926973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.927262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.927886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.929490 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:34.939913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1332/2660] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:34.944010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:34.954183 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d1da-f0e9-4cc9-80fe-699a22e92562 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:34.958962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:34.959604 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:34.959882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:34.960153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] PATH_INFO: `/v3/projects/2471fafd81a4462483ce9c7fd7dc4a1f/users/431d0ea02e044414805235b35418d17e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:34.975446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2471fafd81a4462483ce9c7fd7dc4a1f, user_id=431d0ea02e044414805235b35418d17e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:34.978131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:35.083958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1329/2661] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:34 2022] PUT /identity/v3/projects/2471fafd81a4462483ce9c7fd7dc4a1f/users/431d0ea02e044414805235b35418d17e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:35.087896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:35.099893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052001-66b3-4afa-8610-2d3d0c6fdb15 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:35.112952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:35.158530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14fb54-5051-403a-b62d-4486e4139c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:35.159125 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb54-5051-403a-b62d-4486e4139c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:35.159402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb54-5051-403a-b62d-4486e4139c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:35.159672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb54-5051-403a-b62d-4486e4139c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:35.160300 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14fb54-5051-403a-b62d-4486e4139c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:35.161974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14fb54-5051-403a-b62d-4486e4139c9a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:35.171464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1333/2662] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:35.176511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:35.186659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397888-0bc7-456e-bb2d-67e4d501e2da admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:35.191362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:35.191997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:35.192272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:35.192539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] PATH_INFO: `/v3/projects/2471fafd81a4462483ce9c7fd7dc4a1f/users/431d0ea02e044414805235b35418d17e/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:35.194394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2471fafd81a4462483ce9c7fd7dc4a1f, user_id=431d0ea02e044414805235b35418d17e, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:35.197007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:35.206970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1330/2663] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:35 2022] PUT /identity/v3/projects/2471fafd81a4462483ce9c7fd7dc4a1f/users/431d0ea02e044414805235b35418d17e/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:35.218367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:35.219183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:35.219507 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:35.248263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] MFA Rules not processed for user `431d0ea02e044414805235b35418d17e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:35.249489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:35.315441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1334/2664] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:35.326726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:35.328439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:35.389738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090e763-566a-4bdc-af50-e12e08f894d2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:35.393377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:35.393972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:35.394242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:35.394506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:35.403385 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:35.404798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:35.414675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1331/2665] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:35.621844 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:35.631618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd52fa-5fde-4308-9b95-1284549a15cd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:35.635983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:35.635983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:35.635983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:35.636260 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:35.637935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:35.698548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:35.700066 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c09171-c234-41b6-86fd-dbf52360fe3a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:35.710830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1335/2666] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:44.294976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:44.359836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c588e6f-67a1-4fdf-943d-4e3b626db9ac service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:44.365388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:44.365944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:44.366219 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:44.366515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] PATH_INFO: `/v3/users/09b2c20708ba4a5a89732d7d8cc6ac6a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:44.367753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b2c20708ba4a5a89732d7d8cc6ac6a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:44.369697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:44.610131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b2c20708ba4a5a89732d7d8cc6ac6a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:44.611059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b2c20708ba4a5a89732d7d8cc6ac6a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:44.611706 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b2c20708ba4a5a89732d7d8cc6ac6a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:44.618977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b2c20708ba4a5a89732d7d8cc6ac6a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:44.715236 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b2c20708ba4a5a89732d7d8cc6ac6a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:44.716691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:44.734408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1332/2667] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:44 2022] DELETE /identity/v3/users/09b2c20708ba4a5a89732d7d8cc6ac6a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:44.739101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:44.743115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:44.743115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:44.758776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:44.759968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:44.791200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:44.821360 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1336/2668] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:44.831771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:44.841040 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:44.891023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705646-3cf6-47ee-9eb3-e03fb92829d9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:44.898548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:44.899184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:44.899463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:44.899734 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:44.910370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:44.911925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:44.923694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1333/2669] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:45.341750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:45.343216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:45.355937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616533-5cff-4ce0-8be8-d8c3f51a47f4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:45.361353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:45.361981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:45.362256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:45.362522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] PATH_INFO: `/v3/projects/6a61369d132c4871be75f56bab740ef1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:45.363638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a61369d132c4871be75f56bab740ef1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:45.365603 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:45.477190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a61369d132c4871be75f56bab740ef1', 'request_id': 'req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.578245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a61369d132c4871be75f56bab740ef1', 'request_id': 'req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.584452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a61369d132c4871be75f56bab740ef1', 'request_id': 'req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.596546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] The token cache is being invalidate because project 6a61369d132c4871be75f56bab740ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:45.596825 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.597472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.599374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1337/2670] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:45 2022] DELETE /identity/v3/projects/6a61369d132c4871be75f56bab740ef1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:45.603009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:45.613571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb7863-a673-4259-94e1-03015dd96764 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:45.673159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:45.673814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:45.674093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:45.674365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] PATH_INFO: `/v3/users/431d0ea02e044414805235b35418d17e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:45.675574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=431d0ea02e044414805235b35418d17e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:45.677514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:45.901410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431d0ea02e044414805235b35418d17e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.901976 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431d0ea02e044414805235b35418d17e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.902573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431d0ea02e044414805235b35418d17e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.910574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431d0ea02e044414805235b35418d17e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:45.979412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-55869dda-5416-4814-a988-c4b6369d51ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431d0ea02e044414805235b35418d17e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:46.000960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1334/2671] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:45 2022] DELETE /identity/v3/users/431d0ea02e044414805235b35418d17e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:46.495873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:46.497670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:46.511612 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467bb1a-1eee-4d7b-a1e7-55162cfbc704 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:46.574705 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:46.575331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:46.575621 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:46.575873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] PATH_INFO: `/v3/projects/2471fafd81a4462483ce9c7fd7dc4a1f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:46.576974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2471fafd81a4462483ce9c7fd7dc4a1f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:46.579647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:46.695309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2471fafd81a4462483ce9c7fd7dc4a1f', 'request_id': 'req-3f81c338-c743-479c-817d-df5d0b6031b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:46.751965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2471fafd81a4462483ce9c7fd7dc4a1f', 'request_id': 'req-3f81c338-c743-479c-817d-df5d0b6031b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:46.756207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:46.758596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2471fafd81a4462483ce9c7fd7dc4a1f', 'request_id': 'req-3f81c338-c743-479c-817d-df5d0b6031b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:46.770339 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] The token cache is being invalidate because project 2471fafd81a4462483ce9c7fd7dc4a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:46.770627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:46.771273 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3f81c338-c743-479c-817d-df5d0b6031b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:46.772786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1338/2672] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:46 2022] DELETE /identity/v3/projects/2471fafd81a4462483ce9c7fd7dc4a1f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:46.777834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:46.778367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:46.778367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:46.787079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:46.799708 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:46.800941 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:46.864468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1335/2673] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:46.873007 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:46.873322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:46.873594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:46.893942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:46.895137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:46.902972 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1339/2674] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:46.907469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:46.916995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97468c3-1c49-44e0-ae79-3f361ddb9a57 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:46.921606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:46.926500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:46.926500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:46.926500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:46.926500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:46.926500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:46.926500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:46.937741 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1336/2675] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:52:46.942744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:46.952101 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae511f-4cc5-4ff8-a6ee-aebfba0557ec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:46.957162 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:46.957779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:46.958053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:46.958318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:46.958935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:46.960840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:47.068009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1340/2676] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:46 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:47.072057 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:47.082080 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70ffb-0297-4b8a-8f83-479b8fee9808 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:47.139849 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:47.140441 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.140714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.140978 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.141735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:47.143647 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:47.275972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1337/2677] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:47 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:47.280395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:47.298839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a2e4-b152-46ad-8eea-80316e76dff5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:47.303581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:47.304178 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.304460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.304714 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.305390 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:47.307180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:47.320969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1341/2678] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:47.322420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:47.333913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17029cbc-4e89-4e4e-aa2d-ffac7638dbb4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:47.340677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea1b8-be13-437c-9e31-7c91afaf4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:47.341307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea1b8-be13-437c-9e31-7c91afaf4616 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.341882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea1b8-be13-437c-9e31-7c91afaf4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.341882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea1b8-be13-437c-9e31-7c91afaf4616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.342456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ea1b8-be13-437c-9e31-7c91afaf4616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:47.344033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ea1b8-be13-437c-9e31-7c91afaf4616 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:47.356345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1338/2679] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:52:47.361451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:47.372408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d924fe3-d1a6-4bde-8140-4f3f047d7648 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:47.377267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:47.377920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.378199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.378474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] PATH_INFO: `/v3/projects/3898901b5f1344288174eda5bc5b05c7/users/ab8df766f54d4349998262670f849b1b/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.396217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3898901b5f1344288174eda5bc5b05c7, user_id=ab8df766f54d4349998262670f849b1b, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:47.399431 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:47.488960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1342/2680] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:47 2022] PUT /identity/v3/projects/3898901b5f1344288174eda5bc5b05c7/users/ab8df766f54d4349998262670f849b1b/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:47.499300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.499589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.499890 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.548631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] MFA Rules not processed for user `ab8df766f54d4349998262670f849b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:47.550050 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:47.638186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:47.644869 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1339/2681] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:47.648921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:47.724640 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6c0a-0289-4979-9763-2a528c868f7c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:47.729553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:47.730148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.730425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.730695 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.731323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:47.733261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:47.851061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1343/2682] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:47 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:47.855074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:47.867094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123171b-37a7-49ea-87c2-827af59afe67 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:47.943077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:47.944116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:47.944416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:47.944685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:47.945437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:47.947351 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:48.043134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1340/2683] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:47 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:48.046980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:48.058296 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f41c54-84a3-4863-a441-02c8163627d9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:48.063183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:48.067902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:48.067902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:48.067902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:48.067902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:48.067902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:48.078771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1344/2684] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:48.083170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:48.094611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67f99-dd73-4887-b8ac-d993d4285c2c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:48.099605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:48.100379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:48.100659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:48.100930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] PATH_INFO: `/v3/projects/4c2e573c6cd04aa5addc6ceb2b54d224/users/12acdc49b99a4301be64f4217b7d359a/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:48.119569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2e573c6cd04aa5addc6ceb2b54d224, user_id=12acdc49b99a4301be64f4217b7d359a, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:48.119913 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:48.221433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1341/2685] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:48 2022] PUT /identity/v3/projects/4c2e573c6cd04aa5addc6ceb2b54d224/users/12acdc49b99a4301be64f4217b7d359a/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:48.225528 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:48.238041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed40e1-48d9-439b-82a5-ccbb2c11440a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:48.303374 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceb68d-a6f9-46f8-b3b4-5d6137ecf37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:48.303981 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceb68d-a6f9-46f8-b3b4-5d6137ecf37c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:48.304259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceb68d-a6f9-46f8-b3b4-5d6137ecf37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:48.304522 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceb68d-a6f9-46f8-b3b4-5d6137ecf37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:48.305302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceb68d-a6f9-46f8-b3b4-5d6137ecf37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:48.306977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceb68d-a6f9-46f8-b3b4-5d6137ecf37c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:48.308527 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:48.322279 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1345/2686] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:48.323681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:48.335844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356ed8d-debd-42bc-bd81-b874c85cf1fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:48.342005 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:48.342672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:48.342945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:48.343215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] PATH_INFO: `/v3/projects/4c2e573c6cd04aa5addc6ceb2b54d224/users/12acdc49b99a4301be64f4217b7d359a/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:48.345924 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2e573c6cd04aa5addc6ceb2b54d224, user_id=12acdc49b99a4301be64f4217b7d359a, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:48.348677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:48.360751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1342/2687] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:48 2022] PUT /identity/v3/projects/4c2e573c6cd04aa5addc6ceb2b54d224/users/12acdc49b99a4301be64f4217b7d359a/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:48.372290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:48.372482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:48.372744 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:48.408921 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] MFA Rules not processed for user `12acdc49b99a4301be64f4217b7d359a`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:48.410958 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:48.502790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1346/2688] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:48.511490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:48.513378 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:48.580265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14973-5f4f-45ae-a965-76821fbf24cd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:48.589498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:48.590134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:48.590409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:48.590672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:48.601641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:48.603748 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:48.614577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1343/2689] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:49.603315 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:49.618576 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2bf6-cf5b-49e0-96e1-1a0aeb9118c4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:49.623819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12acdc49b99a4301be64f4217b7d359a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c2e573c6cd04aa5addc6ceb2b54d224', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:49.624772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:49.624772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:49.625277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:49.626040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:49.626435 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:49.628128 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:49.640513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1347/2690] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:52:49.645153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:49.654799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff4d3-61fe-4edb-85f0-6bd4e0d741f8 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:49.660035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12acdc49b99a4301be64f4217b7d359a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c2e573c6cd04aa5addc6ceb2b54d224', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:49.660671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:49.660960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:49.661254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:49.662090 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:49.664039 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:49.730635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1344/2691] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:49 2022] POST /identity/v3/projects => generated 353 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:49.737706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:49.747609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9c18-90a1-4abd-9b03-0cf75fe2d1cc tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:49.804585 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12acdc49b99a4301be64f4217b7d359a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c2e573c6cd04aa5addc6ceb2b54d224', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:49.805182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:49.805488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:49.805758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:49.806388 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:49.806732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:49.808329 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:49.820395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1348/2692] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:52:49.866186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:49.877704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc665db-10a6-4297-8ffb-306324a10b4f tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:49.882400 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12acdc49b99a4301be64f4217b7d359a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c2e573c6cd04aa5addc6ceb2b54d224', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:49.883017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:49.883293 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:49.883560 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] PATH_INFO: `/v3/projects/24c92e78154747bd8788791b45e7279a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:49.884666 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24c92e78154747bd8788791b45e7279a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:49.886789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:50.002618 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:50.019449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c92e78154747bd8788791b45e7279a', 'request_id': 'req-66453fd8-9fed-4d21-9ea8-590f13d8ba22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:50.025184 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c92e78154747bd8788791b45e7279a', 'request_id': 'req-66453fd8-9fed-4d21-9ea8-590f13d8ba22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:50.086715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c92e78154747bd8788791b45e7279a', 'request_id': 'req-66453fd8-9fed-4d21-9ea8-590f13d8ba22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:50.100202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] The token cache is being invalidate because project 24c92e78154747bd8788791b45e7279a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:50.100483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:50.101142 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-66453fd8-9fed-4d21-9ea8-590f13d8ba22 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:50.106239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1345/2693] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:49 2022] DELETE /identity/v3/projects/24c92e78154747bd8788791b45e7279a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:50.812346 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:50.815056 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:50.883483 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a452d-df91-47fe-aa79-da36b9ba51b4 tempest-VolumeQuotaClassesTest-1930153528 tempest-VolumeQuotaClassesTest-1930153528-project-admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:50.888021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:50.940108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:50.940725 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:50.940999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:50.941292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] PATH_INFO: `/v3/users/ab8df766f54d4349998262670f849b1b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:50.942428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8df766f54d4349998262670f849b1b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:50.944354 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:51.145819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8df766f54d4349998262670f849b1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:51.146460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8df766f54d4349998262670f849b1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:51.211832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8df766f54d4349998262670f849b1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:51.220113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8df766f54d4349998262670f849b1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:51.220759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8df766f54d4349998262670f849b1b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:51.238426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1349/2694] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:50 2022] DELETE /identity/v3/users/ab8df766f54d4349998262670f849b1b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:51.243243 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:51.243705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:51.243827 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:51.262085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:51.263268 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:51.320032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1346/2695] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:51.330517 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:51.331935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:51.390778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8acb1-4fbb-446c-b621-8a44ffc5fad9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:51.394593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:51.395189 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:51.395466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:51.395733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:51.404427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:51.405903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:51.415447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1350/2696] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:51.845538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:51.847130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:51.859562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534b33-635b-4e88-acde-fe917e834745 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:51.864997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:51.869673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:51.869673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:51.869673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] PATH_INFO: `/v3/projects/3898901b5f1344288174eda5bc5b05c7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:51.869673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3898901b5f1344288174eda5bc5b05c7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:51.869673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:52.006075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3898901b5f1344288174eda5bc5b05c7', 'request_id': 'req-c9b79f47-7a3f-441a-a8ab-992356b96f64'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.013382 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3898901b5f1344288174eda5bc5b05c7', 'request_id': 'req-c9b79f47-7a3f-441a-a8ab-992356b96f64'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.093837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3898901b5f1344288174eda5bc5b05c7', 'request_id': 'req-c9b79f47-7a3f-441a-a8ab-992356b96f64'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.106202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] The token cache is being invalidate because project 3898901b5f1344288174eda5bc5b05c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:52.106425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.107051 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.108641 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1347/2697] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:51 2022] DELETE /identity/v3/projects/3898901b5f1344288174eda5bc5b05c7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:52.113079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:52.123422 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be560-81d3-44d2-9874-ff2571d44dbe service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:52.152557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:52.180588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:52.181232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:52.181512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:52.181778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] PATH_INFO: `/v3/users/12acdc49b99a4301be64f4217b7d359a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:52.182869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12acdc49b99a4301be64f4217b7d359a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:52.184843 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:52.444776 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12acdc49b99a4301be64f4217b7d359a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.445470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12acdc49b99a4301be64f4217b7d359a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.520758 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12acdc49b99a4301be64f4217b7d359a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.529904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12acdc49b99a4301be64f4217b7d359a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.530774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-990a350c-f94f-425e-969d-c0e80e432e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12acdc49b99a4301be64f4217b7d359a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:52.553321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1351/2698] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:52:52 2022] DELETE /identity/v3/users/12acdc49b99a4301be64f4217b7d359a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:52.924675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:52.926240 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:52.940368 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79f47-7a3f-441a-a8ab-992356b96f64 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:52.974768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:52.997158 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:52.998003 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:52.998278 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:52.998546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] PATH_INFO: `/v3/projects/4c2e573c6cd04aa5addc6ceb2b54d224` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:52.999645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2e573c6cd04aa5addc6ceb2b54d224)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.001584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:53.151611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2e573c6cd04aa5addc6ceb2b54d224', 'request_id': 'req-4159c3f4-2223-4c10-bceb-30bcb8144a24'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:53.157122 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2e573c6cd04aa5addc6ceb2b54d224', 'request_id': 'req-4159c3f4-2223-4c10-bceb-30bcb8144a24'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:53.229732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2e573c6cd04aa5addc6ceb2b54d224', 'request_id': 'req-4159c3f4-2223-4c10-bceb-30bcb8144a24'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:53.241874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] The token cache is being invalidate because project 4c2e573c6cd04aa5addc6ceb2b54d224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:52:53.242164 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:53.242811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4159c3f4-2223-4c10-bceb-30bcb8144a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:52:53.244290 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1348/2699] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:52:52 2022] DELETE /identity/v3/projects/4c2e573c6cd04aa5addc6ceb2b54d224 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:53.250079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.250548 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.250731 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.272020 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:53.273251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:53.456201 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1352/2700] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:53.464412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.464693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.464963 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.485208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:53.486566 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:53.494370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1349/2701] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:53.498594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:53.508161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061f422-2957-4f39-8444-0e5f3f3cfc13 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:53.512656 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:53.513262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.513544 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.513813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.514445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:52:53.514739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.516317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:53.528359 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1353/2702] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:52:53.532408 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:53.542120 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b194a72-50eb-4375-87c6-7a90ad0e1779 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:53.546929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:53.547514 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.547784 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.548046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.548683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.550574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:53.690375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1350/2703] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:53 2022] POST /identity/v3/projects => generated 407 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:53.694724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:53.705391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cafce-7c0f-4e26-b894-9dec28106039 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:53.740494 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:53.763655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:53.764256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.764535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.764810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.765609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.768139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:53.869426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1354/2704] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:53 2022] POST /identity/v3/users => generated 304 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:52:53.873745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:53.884664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09653f73-5896-482c-a3d6-513679c88fc9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:53.889623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:53.890381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.890844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.891133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.891795 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.894416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:53.905415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1351/2705] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:53.909583 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:53.919664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49aa95-dc4d-4fb1-999e-260b37bfa51a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:53.924207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f155-7103-4834-b92e-0c070918e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:53.924809 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f155-7103-4834-b92e-0c070918e956 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.925070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f155-7103-4834-b92e-0c070918e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.925377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f155-7103-4834-b92e-0c070918e956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.930534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f155-7103-4834-b92e-0c070918e956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.930534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f155-7103-4834-b92e-0c070918e956 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:53.937721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1355/2706] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:52:53.942453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:53.952769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaff585-75fe-4048-b9d6-b040ad80e5c8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:53.958329 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:53.959221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:53.959221 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:53.959561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] PATH_INFO: `/v3/projects/b9f8e46041ea4f98b98ea733356fb3c8/users/11e6e39c3faf4ad188e2c6ed0352a9e9/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:53.975545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f8e46041ea4f98b98ea733356fb3c8, user_id=11e6e39c3faf4ad188e2c6ed0352a9e9, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:53.978323 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.092925 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1352/2707] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:53 2022] PUT /identity/v3/projects/b9f8e46041ea4f98b98ea733356fb3c8/users/11e6e39c3faf4ad188e2c6ed0352a9e9/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:54.104553 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.104837 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.105108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.133556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] MFA Rules not processed for user `11e6e39c3faf4ad188e2c6ed0352a9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:54.134763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:54.198282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1356/2708] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:54.202850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:54.262772 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e047-880a-44af-b44a-c6f8901d307e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:54.267569 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:54.268161 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.268433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.268698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.269349 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:54.271228 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.280345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:54.379516 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1353/2709] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:52:54 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:54.380704 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:54.391474 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e37e4-3513-46cb-823e-bdc9766ebc43 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:54.450764 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:54.451460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.451810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.452150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.452873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:54.455076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.539952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1357/2710] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:52:54 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:52:54.544774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:54.555911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398e61-e783-4f59-9a80-a63f65fcca0f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:54.560502 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:54.561092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.561395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.561664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.562320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:54.563959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.576201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1354/2711] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:54.587192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:54.598307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4bc7-6bc1-4a9f-8418-6c48f6b95ad4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:54.603085 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:54.603647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.603920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.604185 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] PATH_INFO: `/v3/projects/687067bff05a4d93b52e15c532d22065/users/d1f3791eda004a41a2f2419754716a04/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.623541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687067bff05a4d93b52e15c532d22065, user_id=d1f3791eda004a41a2f2419754716a04, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:54.626794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.711915 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1358/2712] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:54 2022] PUT /identity/v3/projects/687067bff05a4d93b52e15c532d22065/users/d1f3791eda004a41a2f2419754716a04/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:52:54.716232 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:54.727152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b42fd-ca8b-4afc-830c-476ec912f2bc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:54.785828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171016-1fc0-4d24-b1b5-60bf5e724612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:54.786567 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171016-1fc0-4d24-b1b5-60bf5e724612 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.786846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171016-1fc0-4d24-b1b5-60bf5e724612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.787111 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171016-1fc0-4d24-b1b5-60bf5e724612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.787746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171016-1fc0-4d24-b1b5-60bf5e724612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:54.789370 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171016-1fc0-4d24-b1b5-60bf5e724612 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.804440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1355/2713] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:52:54.808757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:54.822691 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82927e53-5201-4686-8a3c-b222fcec75c5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:54.827684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:54.828455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.828803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.829145 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] PATH_INFO: `/v3/projects/687067bff05a4d93b52e15c532d22065/users/d1f3791eda004a41a2f2419754716a04/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.831835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] RBAC: Authorizing `identity:create_grant(project_id=687067bff05a4d93b52e15c532d22065, user_id=d1f3791eda004a41a2f2419754716a04, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:54.834790 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:54.841795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:54.850536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1359/2714] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:52:54 2022] PUT /identity/v3/projects/687067bff05a4d93b52e15c532d22065/users/d1f3791eda004a41a2f2419754716a04/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:52:54.862571 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:54.862811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:54.863034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:54.894202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] MFA Rules not processed for user `d1f3791eda004a41a2f2419754716a04`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:52:54.896661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:54.995102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1356/2715] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:52:55.015491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:55.018617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:52:55.087385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d619f4f-c75e-4280-bb1a-4aafbef1132f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:55.091692 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866f37a-2b81-47da-b0ee-7b2e5d9b8d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:55.092458 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866f37a-2b81-47da-b0ee-7b2e5d9b8d15 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:55.092965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866f37a-2b81-47da-b0ee-7b2e5d9b8d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:55.093392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866f37a-2b81-47da-b0ee-7b2e5d9b8d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:55.106055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866f37a-2b81-47da-b0ee-7b2e5d9b8d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:55.108438 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866f37a-2b81-47da-b0ee-7b2e5d9b8d15 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:55.120646 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1360/2716] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:55 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:52:55.559785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:52:55.575072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ae783-e42c-4320-9b87-0a64512d0dd2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:52:55.582774 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:52:55.583499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:52:55.585991 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:52:55.586348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:52:55.672809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:52:55.674857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:52:55.678834 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:52:55.685308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1357/2717] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:52:55 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:00.740745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762bc61-b43e-4419-9ed1-7c4f5be4246d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:00.741291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762bc61-b43e-4419-9ed1-7c4f5be4246d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:00.741291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762bc61-b43e-4419-9ed1-7c4f5be4246d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:00.759788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d762bc61-b43e-4419-9ed1-7c4f5be4246d None None] MFA Rules not processed for user `5694e0c4dda94544bad91e5b9cb13b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:00.760965 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d762bc61-b43e-4419-9ed1-7c4f5be4246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:00.814700 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1361/2718] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:02.789500 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:02.853639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478f51-793e-49aa-8d09-e89eb8e7f627 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:02.858059 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:02.858676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:02.858950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:02.859213 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] PATH_INFO: `/v3/users/11e6e39c3faf4ad188e2c6ed0352a9e9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:02.860308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e6e39c3faf4ad188e2c6ed0352a9e9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:02.862270 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:03.032693 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e6e39c3faf4ad188e2c6ed0352a9e9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:03.033284 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e6e39c3faf4ad188e2c6ed0352a9e9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:03.034593 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e6e39c3faf4ad188e2c6ed0352a9e9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:03.042085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e6e39c3faf4ad188e2c6ed0352a9e9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:03.132258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e6e39c3faf4ad188e2c6ed0352a9e9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:03.151961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1358/2719] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:02 2022] DELETE /identity/v3/users/11e6e39c3faf4ad188e2c6ed0352a9e9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:03.156530 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:03.158272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:03.158272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:03.179043 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:03.180317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:03.240711 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1362/2720] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:03.254085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:03.255505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:03.312697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1c4f-db48-44fd-ad92-3e5741d87f85 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:03.316589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:03.317238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:03.317520 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:03.317787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:03.326683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:03.328095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:03.338598 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1359/2721] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:03.792425 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:03.794050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:03.806952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d09a5-eaf4-4ce4-ab9d-efbbe8a2b149 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:03.827879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:03.828609 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:03.829095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:03.829595 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] PATH_INFO: `/v3/projects/b9f8e46041ea4f98b98ea733356fb3c8` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:03.832075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f8e46041ea4f98b98ea733356fb3c8)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:03.838150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:03.957047 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:03.963334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f8e46041ea4f98b98ea733356fb3c8', 'request_id': 'req-a831aab7-692d-42c6-9c8a-841c69df72c8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.046738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f8e46041ea4f98b98ea733356fb3c8', 'request_id': 'req-a831aab7-692d-42c6-9c8a-841c69df72c8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.056523 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f8e46041ea4f98b98ea733356fb3c8', 'request_id': 'req-a831aab7-692d-42c6-9c8a-841c69df72c8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.070894 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] The token cache is being invalidate because project b9f8e46041ea4f98b98ea733356fb3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:04.071261 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.072155 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.073935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1363/2722] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:03 2022] DELETE /identity/v3/projects/b9f8e46041ea4f98b98ea733356fb3c8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:04.077998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:04.092749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa34d-7d57-4da9-921f-9d5e51f94a06 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:04.126839 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:04.171564 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:04.176103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:04.176103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:04.176103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] PATH_INFO: `/v3/users/d1f3791eda004a41a2f2419754716a04` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:04.176103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f3791eda004a41a2f2419754716a04)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:04.176103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:04.411179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f3791eda004a41a2f2419754716a04'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.411781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f3791eda004a41a2f2419754716a04'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.412455 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f3791eda004a41a2f2419754716a04'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.419452 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f3791eda004a41a2f2419754716a04'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.528275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-99029ce4-588f-4bae-9769-e24149409993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f3791eda004a41a2f2419754716a04'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:04.549898 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1360/2723] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:04 2022] DELETE /identity/v3/users/d1f3791eda004a41a2f2419754716a04 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:05.106896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:05.109274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:05.124721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831aab7-692d-42c6-9c8a-841c69df72c8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:05.199974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:05.200594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.200868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.201133 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] PATH_INFO: `/v3/projects/687067bff05a4d93b52e15c532d22065` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.202450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=687067bff05a4d93b52e15c532d22065)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:05.204131 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:05.306512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687067bff05a4d93b52e15c532d22065', 'request_id': 'req-49f573f1-c8e4-4cc1-986d-12d17f5897ec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:05.384836 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687067bff05a4d93b52e15c532d22065', 'request_id': 'req-49f573f1-c8e4-4cc1-986d-12d17f5897ec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:05.391418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687067bff05a4d93b52e15c532d22065', 'request_id': 'req-49f573f1-c8e4-4cc1-986d-12d17f5897ec'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:05.403566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] The token cache is being invalidate because project 687067bff05a4d93b52e15c532d22065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:05.403858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:05.404498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-49f573f1-c8e4-4cc1-986d-12d17f5897ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:05.406013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1364/2724] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:05 2022] DELETE /identity/v3/projects/687067bff05a4d93b52e15c532d22065 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:05.411623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.413765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.413765 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.432528 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:05.433764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:05.496955 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1361/2725] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:05.508190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.508190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.508190 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.525473 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:05.526655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:05.535156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1365/2726] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:05.539845 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:05.550605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33dc3f-26bd-4f83-8b9e-421af286bae6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:05.555654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:05.556244 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.556525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.556804 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.557506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:53:05.557808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:05.559396 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:05.572192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1362/2727] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:53:05.576554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:05.586164 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916a2ad-7305-4e28-a279-ee3af3adcd3b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:05.591424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:05.591968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.592246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.592516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.593146 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:05.595134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:05.729093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1366/2728] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:53:05 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:05.733506 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:05.744327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d7a62-05f3-4ba9-9459-d403c580c2c7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:05.770599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:05.807333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:05.807957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.808285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.808556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.809237 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:05.811210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:05.916538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1363/2729] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:53:05 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:05.920733 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:05.931071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59c2f0-155c-4c09-b574-2e94f5421f25 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:05.935993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:05.936590 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.936864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.937126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.937867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:05.939455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:05.954622 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1367/2730] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:05.963785 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:05.969824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13761cd-bd44-4489-9ddc-9eaed667b109 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:05.975136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05cae-f717-4d1c-90c0-a899ede5e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:05.975739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05cae-f717-4d1c-90c0-a899ede5e113 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:05.976177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05cae-f717-4d1c-90c0-a899ede5e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:05.976449 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05cae-f717-4d1c-90c0-a899ede5e113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:05.977083 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05cae-f717-4d1c-90c0-a899ede5e113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:05.979336 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05cae-f717-4d1c-90c0-a899ede5e113 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:05.989819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1364/2731] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:05.993980 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.006504 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9b5a-3a3d-4b88-a2f2-8eb546967cfd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.011387 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.012035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.012311 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.012580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] PATH_INFO: `/v3/projects/d00aec7ac4d24ca88e7bba88d5648f3f/users/68d27d6c804b4970b0b3b340d0cb154d/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.028674 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00aec7ac4d24ca88e7bba88d5648f3f, user_id=68d27d6c804b4970b0b3b340d0cb154d, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.031428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.034936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:06.143717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1368/2732] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:05 2022] PUT /identity/v3/projects/d00aec7ac4d24ca88e7bba88d5648f3f/users/68d27d6c804b4970b0b3b340d0cb154d/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:53:06.155584 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.155960 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.156391 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.189036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] MFA Rules not processed for user `68d27d6c804b4970b0b3b340d0cb154d`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:06.190823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:06.263511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1365/2733] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:06.267746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.331659 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317ed15-a0be-4ef9-bed3-f8683523aead admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.336851 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.337827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.340596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.340596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.340596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.341076 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.438593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1369/2734] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:53:06 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:06.443177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.454731 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b85e40-e2d5-46a6-b210-2810a4a8a89a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.512819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.513447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.513727 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.513993 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.514629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.516532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.608936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1366/2735] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:53:06 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:06.612156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.622485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717551dd-7c19-4077-8507-74743e2f3ab3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.627019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.628297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.629104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.629104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.629600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.631181 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.641652 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1370/2736] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:06.646551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.656454 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6c402-0744-4cb8-98ab-19b547bc41d4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.661096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.661763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.662038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.662307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] PATH_INFO: `/v3/projects/b6eeac3319664c1e8ad69b4e4750e7d3/users/d4c633bb61bd4dff9806df66948e0cc4/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.676654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eeac3319664c1e8ad69b4e4750e7d3, user_id=d4c633bb61bd4dff9806df66948e0cc4, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.679308 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.744026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:06.748439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1367/2737] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:06 2022] PUT /identity/v3/projects/b6eeac3319664c1e8ad69b4e4750e7d3/users/d4c633bb61bd4dff9806df66948e0cc4/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:06.753188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.763600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02dac5-385d-409e-843f-7b8a862c3fa6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.819588 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b451b-0019-4a36-aafa-75b524f7d03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.820183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b451b-0019-4a36-aafa-75b524f7d03e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.820460 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b451b-0019-4a36-aafa-75b524f7d03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.820732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b451b-0019-4a36-aafa-75b524f7d03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.821454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b451b-0019-4a36-aafa-75b524f7d03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.823084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b451b-0019-4a36-aafa-75b524f7d03e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.834115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1371/2738] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:06.838660 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.849392 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78255780-f062-480d-9d03-b4ce441a18af admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:06.854081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:06.854723 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.854999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.855269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] PATH_INFO: `/v3/projects/b6eeac3319664c1e8ad69b4e4750e7d3/users/d4c633bb61bd4dff9806df66948e0cc4/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.857238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eeac3319664c1e8ad69b4e4750e7d3, user_id=d4c633bb61bd4dff9806df66948e0cc4, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:06.859936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:06.870743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1368/2739] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:06 2022] PUT /identity/v3/projects/b6eeac3319664c1e8ad69b4e4750e7d3/users/d4c633bb61bd4dff9806df66948e0cc4/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:06.881771 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:06.882053 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:06.882321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:06.910069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] MFA Rules not processed for user `d4c633bb61bd4dff9806df66948e0cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:06.911269 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:06.961471 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:06.978434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1372/2740] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:06.989633 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:06.991307 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:07.049006 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378368-f663-4529-bcde-5390685acbcf admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:07.053529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b2333-3dc6-4356-b492-fb586ef8ef38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:07.054121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2333-3dc6-4356-b492-fb586ef8ef38 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:07.054399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2333-3dc6-4356-b492-fb586ef8ef38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:07.054668 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2333-3dc6-4356-b492-fb586ef8ef38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:07.063738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b2333-3dc6-4356-b492-fb586ef8ef38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:07.065720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b2333-3dc6-4356-b492-fb586ef8ef38 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:07.075162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1369/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:07.582546 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:07.644616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f19f4-e0ed-4840-a158-d2004f6c2b41 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:07.648999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:07.649638 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:07.649909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:07.650171 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] PATH_INFO: `/v3/users/68d27d6c804b4970b0b3b340d0cb154d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:07.651264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d27d6c804b4970b0b3b340d0cb154d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:07.653168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:07.810423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d27d6c804b4970b0b3b340d0cb154d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:07.811057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d27d6c804b4970b0b3b340d0cb154d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:07.864336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d27d6c804b4970b0b3b340d0cb154d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:07.871467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d27d6c804b4970b0b3b340d0cb154d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:07.872109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d27d6c804b4970b0b3b340d0cb154d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:07.890367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1373/2742] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:07 2022] DELETE /identity/v3/users/68d27d6c804b4970b0b3b340d0cb154d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:07.895574 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:07.896029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:07.896124 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:07.916129 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:07.917388 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:07.978179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1370/2743] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:53:07.988303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:07.989803 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:08.045123 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7f162-2d76-4183-924e-2a12c32ca9bd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:08.050678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:08.051658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:08.052139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:08.052618 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:08.062379 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:08.063783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:08.073179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1374/2744] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:08.498686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:08.500099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:08.512258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4339a44-68dd-42d1-bdb9-340331ff4e50 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:08.517162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:08.517923 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:08.518205 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:08.519071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] PATH_INFO: `/v3/projects/d00aec7ac4d24ca88e7bba88d5648f3f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:08.520204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00aec7ac4d24ca88e7bba88d5648f3f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:08.522359 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:08.642790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00aec7ac4d24ca88e7bba88d5648f3f', 'request_id': 'req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:08.649586 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00aec7ac4d24ca88e7bba88d5648f3f', 'request_id': 'req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:08.727645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00aec7ac4d24ca88e7bba88d5648f3f', 'request_id': 'req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:08.741177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] The token cache is being invalidate because project d00aec7ac4d24ca88e7bba88d5648f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:08.741490 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:08.742195 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:08.743817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1371/2745] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:08 2022] DELETE /identity/v3/projects/d00aec7ac4d24ca88e7bba88d5648f3f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:08.747780 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:08.758455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4950eac-cf88-48d7-b0d6-d255ac45f52a service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:08.768418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:08.815875 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:08.816663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:08.816938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:08.817285 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] PATH_INFO: `/v3/users/d4c633bb61bd4dff9806df66948e0cc4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:08.818398 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c633bb61bd4dff9806df66948e0cc4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:08.820323 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:09.005183 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c633bb61bd4dff9806df66948e0cc4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.005868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c633bb61bd4dff9806df66948e0cc4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.099356 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c633bb61bd4dff9806df66948e0cc4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.106878 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c633bb61bd4dff9806df66948e0cc4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.107498 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3acb4089-b2a9-4aab-afcb-0def686e35c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c633bb61bd4dff9806df66948e0cc4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.124936 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1375/2746] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:08 2022] DELETE /identity/v3/users/d4c633bb61bd4dff9806df66948e0cc4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:09.580904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:09.582451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:09.595671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d5a0-a3ea-42ea-b7fe-6360e7ce29bc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:09.606642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:09.659883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:09.660614 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:09.661102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:09.661397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] PATH_INFO: `/v3/projects/b6eeac3319664c1e8ad69b4e4750e7d3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:09.662529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6eeac3319664c1e8ad69b4e4750e7d3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:09.664424 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:09.805810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6eeac3319664c1e8ad69b4e4750e7d3', 'request_id': 'req-6a211ec6-ed52-42f1-b65d-49ed1ed59296'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.810056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6eeac3319664c1e8ad69b4e4750e7d3', 'request_id': 'req-6a211ec6-ed52-42f1-b65d-49ed1ed59296'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.933353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6eeac3319664c1e8ad69b4e4750e7d3', 'request_id': 'req-6a211ec6-ed52-42f1-b65d-49ed1ed59296'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.945725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] The token cache is being invalidate because project b6eeac3319664c1e8ad69b4e4750e7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:09.946033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.946750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6a211ec6-ed52-42f1-b65d-49ed1ed59296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:09.948526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1372/2747] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:09 2022] DELETE /identity/v3/projects/b6eeac3319664c1e8ad69b4e4750e7d3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:09.955141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:09.955610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:09.955706 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:09.976480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:09.977708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:10.036221 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1376/2748] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:10.045047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.045361 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.045638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.066362 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:10.067572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:10.075467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1373/2749] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:10.079654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.090092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056164dc-3c80-4bd0-b3a5-fc149851da02 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.097317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.097317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.097317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.097317 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.098009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:53:10.098009 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.098918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.110326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1377/2750] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:53:10.114700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.123879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d8f75-7b04-4090-8cdd-17a4a54fb7e5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.128702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.129406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.129626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.129892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.130508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.132399 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.232106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1374/2751] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:53:10 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:10.236479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.246787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011acb38-6e50-467e-95e5-5e1572d54db4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.263716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:10.302983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.303574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.303869 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.304180 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.304833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.306760 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.425477 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1378/2752] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:53:10 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:10.425768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.425768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a413e-72cb-4ec8-99af-bb07811dfde6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.430858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.431462 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.431738 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.432056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.432707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.434404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.446742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1375/2753] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:10.451286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.462295 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca095-fb01-4b18-88d0-b82c314b7f05 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.467645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26284e-9dd9-41ea-9947-e602ed633c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.468233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26284e-9dd9-41ea-9947-e602ed633c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.468508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26284e-9dd9-41ea-9947-e602ed633c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.468773 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26284e-9dd9-41ea-9947-e602ed633c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.469426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26284e-9dd9-41ea-9947-e602ed633c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.471017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26284e-9dd9-41ea-9947-e602ed633c01 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.482378 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1379/2754] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:10.487328 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.501116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c515-d1c0-4367-8a07-3802e632ce65 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.507332 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.508204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.508685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.509119 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] PATH_INFO: `/v3/projects/2ea07873194049b190559552bdabe1b7/users/7b1e56e6c142403796ab1ca70b852190/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.527143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea07873194049b190559552bdabe1b7, user_id=7b1e56e6c142403796ab1ca70b852190, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.530353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.653928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1376/2755] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:10 2022] PUT /identity/v3/projects/2ea07873194049b190559552bdabe1b7/users/7b1e56e6c142403796ab1ca70b852190/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:10.659496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296040d-70ec-42b7-993d-cf8c9eebbf98 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.659786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296040d-70ec-42b7-993d-cf8c9eebbf98 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.660055 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296040d-70ec-42b7-993d-cf8c9eebbf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.678975 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5296040d-70ec-42b7-993d-cf8c9eebbf98 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:10.680086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5296040d-70ec-42b7-993d-cf8c9eebbf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:10.738104 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1380/2756] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:10.748662 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:10.750036 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:10.793985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:10.807884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2745ec-658d-4d5d-848a-ab9cf0750585 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:10.811627 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:10.812163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:10.812447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:10.812717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:10.822406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:10.823891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:10.833644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1377/2757] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:12.279545 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:12.280143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:12.280143 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:12.317005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] MFA Rules not processed for user `7b1e56e6c142403796ab1ca70b852190`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:12.318275 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:12.385591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1381/2758] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:12.390150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:12.399820 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb73e6-7e18-4755-a514-710f04d4d7ed service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:12.404501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:12.405091 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:12.405404 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:12.405672 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:12.406316 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:12.408238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:12.524029 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1378/2759] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:53:12 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:53:12.528078 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:12.539434 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28742a38-940a-4be8-a6ca-6dcad5f33d5c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:12.564960 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:12.594450 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:12.595057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:12.595411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:12.595681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:12.596302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:12.598998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:12.750779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1382/2760] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:53:12 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:12.755285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:12.765464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5fe8-1a82-47da-a177-73742241a3f8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:12.770445 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:12.771037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:12.771311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:12.771576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:12.772267 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:12.773888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:12.785009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1379/2761] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:12.789065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:12.798942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e76cc-8825-42ad-ab6d-3aafeaabd938 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:12.804543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:12.805184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:12.805495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:12.805769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] PATH_INFO: `/v3/projects/14c5787e06c9423ba64b5c5dae2e346b/users/9ee46add135c41f6a5a6c3e9d5df663f/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:12.820467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c5787e06c9423ba64b5c5dae2e346b, user_id=9ee46add135c41f6a5a6c3e9d5df663f, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:12.823166 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:12.916949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1383/2762] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:12 2022] PUT /identity/v3/projects/14c5787e06c9423ba64b5c5dae2e346b/users/9ee46add135c41f6a5a6c3e9d5df663f/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:12.921028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:12.931369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07aa6b-030e-467a-9dd4-3cf7fc0e4a09 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:12.987761 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f833-0c8a-4382-b896-948a3f39bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:12.988363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f833-0c8a-4382-b896-948a3f39bd08 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:12.988683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f833-0c8a-4382-b896-948a3f39bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:12.988959 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f833-0c8a-4382-b896-948a3f39bd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:12.989642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7f833-0c8a-4382-b896-948a3f39bd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:12.991241 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7f833-0c8a-4382-b896-948a3f39bd08 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:13.002215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1380/2763] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:13.005486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:13.016288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c32c5-67e6-4895-b659-855ce26afe57 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:13.021738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06cda7-f248-4a25-9224-495c3df2661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:13.022416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06cda7-f248-4a25-9224-495c3df2661d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:13.022687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06cda7-f248-4a25-9224-495c3df2661d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:13.022952 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06cda7-f248-4a25-9224-495c3df2661d admin admin] PATH_INFO: `/v3/projects/14c5787e06c9423ba64b5c5dae2e346b/users/9ee46add135c41f6a5a6c3e9d5df663f/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:13.024819 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06cda7-f248-4a25-9224-495c3df2661d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c5787e06c9423ba64b5c5dae2e346b, user_id=9ee46add135c41f6a5a6c3e9d5df663f, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:13.027475 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06cda7-f248-4a25-9224-495c3df2661d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:13.038234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1384/2764] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:13 2022] PUT /identity/v3/projects/14c5787e06c9423ba64b5c5dae2e346b/users/9ee46add135c41f6a5a6c3e9d5df663f/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:53:14.308153 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:14.308669 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:14.308800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:14.345822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] MFA Rules not processed for user `9ee46add135c41f6a5a6c3e9d5df663f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:14.348067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:14.430393 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1381/2765] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:14.500265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:14.500835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:14.500835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:14.520205 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] MFA Rules not processed for user `7b1e56e6c142403796ab1ca70b852190`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:14.521470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:14.577601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1385/2766] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:14.590739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:14.592235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:14.636403 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:14.675710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e47985-728a-43ce-8b42-1063050f4c39 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:14.681047 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:14.681678 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:14.681948 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:14.682212 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:14.690185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:14.691837 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:14.701137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1382/2767] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:14.947535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:15.009157 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fa127-7c19-4c20-af0a-3357dd5dd29e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:15.016805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:15.017806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:15.018891 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:15.019616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:15.021729 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:15.033684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:15.035396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:15.048453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1386/2768] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:24.767546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=20 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:25.041463 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:30.711901 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:30.713719 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:30.770025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37946-95fa-447a-b357-0c87c53f12db service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:30.773619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:30.774210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:30.774485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:30.774752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:30.783515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:30.785508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:30.794798 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1383/2769] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:38.069842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:38.088305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3c4-3315-4ac9-8d7e-a1b76e1f2492 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:38.096626 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:38.098492 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:38.098830 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:38.099173 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:38.102231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:38.121200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:38.124684 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:38.137338 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1387/2770] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:40.790650 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=26 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:48.132106 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:51.359599 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:51.361038 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:51.501591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb33e8-b9c7-40d7-a6bd-d95058279051 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:51.507025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:51.507661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:51.507939 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:51.508208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] PATH_INFO: `/v3/users/f8d99ea85b52442f97fdc0383b759f7f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:51.509444 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d99ea85b52442f97fdc0383b759f7f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:51.511551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:51.823510 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d99ea85b52442f97fdc0383b759f7f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:51.824526 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d99ea85b52442f97fdc0383b759f7f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:51.824979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d99ea85b52442f97fdc0383b759f7f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:51.833501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d99ea85b52442f97fdc0383b759f7f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:51.948523 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d99ea85b52442f97fdc0383b759f7f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:51.968610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1384/2771] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:51 2022] DELETE /identity/v3/users/f8d99ea85b52442f97fdc0383b759f7f => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:52.271867 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:52.311792 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb130-d032-4138-9842-be7bc07eded6 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:52.370396 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:52.371008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:52.371282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:52.371551 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] PATH_INFO: `/v3/projects/7aeca3e3ecf045cd86b34c79f835d50e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:52.372654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aeca3e3ecf045cd86b34c79f835d50e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:52.374573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:52.489410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aeca3e3ecf045cd86b34c79f835d50e', 'request_id': 'req-98c697c1-7988-4527-8325-793ec385a7aa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.575717 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aeca3e3ecf045cd86b34c79f835d50e', 'request_id': 'req-98c697c1-7988-4527-8325-793ec385a7aa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.582508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aeca3e3ecf045cd86b34c79f835d50e', 'request_id': 'req-98c697c1-7988-4527-8325-793ec385a7aa'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.594060 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] The token cache is being invalidate because project 7aeca3e3ecf045cd86b34c79f835d50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:52.594297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.594945 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.597015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1388/2772] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:52 2022] DELETE /identity/v3/projects/7aeca3e3ecf045cd86b34c79f835d50e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:52.600830 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:52.602505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:52.619512 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512fb6-923e-414e-9abf-e2d7978e4e63 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:52.635259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:52.687810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:52.688084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:52.688367 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:52.688638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] PATH_INFO: `/v3/users/763963a5cb5545c296f5d4319c8041ff` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:52.690658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763963a5cb5545c296f5d4319c8041ff)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:52.692967 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:52.855107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763963a5cb5545c296f5d4319c8041ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.855808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763963a5cb5545c296f5d4319c8041ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.856414 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763963a5cb5545c296f5d4319c8041ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.863659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763963a5cb5545c296f5d4319c8041ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.981555 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763963a5cb5545c296f5d4319c8041ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:52.999487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1385/2773] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:52 2022] DELETE /identity/v3/users/763963a5cb5545c296f5d4319c8041ff => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:53.009791 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:53.011272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:53.086883 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c697c1-7988-4527-8325-793ec385a7aa admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:53.092565 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:53.141406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:53.142032 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:53.142303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:53.142568 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:53.145059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:53.212395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:53.213886 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:53.223979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1389/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:53.526686 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:53.528185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:53.545530 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec592d-7f4a-4658-b356-b53c40993b88 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:53.551485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:53.552254 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:53.552677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:53.553072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] PATH_INFO: `/v3/projects/82cc9c44a41944fd81b2455e3711b25d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:53.554663 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cc9c44a41944fd81b2455e3711b25d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:53.556822 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:53.681541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cc9c44a41944fd81b2455e3711b25d', 'request_id': 'req-3e12ac48-98fe-4b22-b6a4-2c084794ca51'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:53.687909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cc9c44a41944fd81b2455e3711b25d', 'request_id': 'req-3e12ac48-98fe-4b22-b6a4-2c084794ca51'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:53.792836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cc9c44a41944fd81b2455e3711b25d', 'request_id': 'req-3e12ac48-98fe-4b22-b6a4-2c084794ca51'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:53.807276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] The token cache is being invalidate because project 82cc9c44a41944fd81b2455e3711b25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:53.807559 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:53.808210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:53.809796 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1386/2775] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:53 2022] DELETE /identity/v3/projects/82cc9c44a41944fd81b2455e3711b25d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:55.489154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:55.489708 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:55.504064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf128a-4017-4af4-8a7a-b36b69599905 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:55.576818 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:55.577556 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:55.577948 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:55.578395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] PATH_INFO: `/v3/users/7b1e56e6c142403796ab1ca70b852190` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:55.580756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1e56e6c142403796ab1ca70b852190)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:55.582734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:55.815108 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1e56e6c142403796ab1ca70b852190'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:55.815937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1e56e6c142403796ab1ca70b852190'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:55.891550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1e56e6c142403796ab1ca70b852190'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:55.897579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:55.900913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1e56e6c142403796ab1ca70b852190'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:55.902739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1e56e6c142403796ab1ca70b852190'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:55.924861 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1390/2776] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:55 2022] DELETE /identity/v3/users/7b1e56e6c142403796ab1ca70b852190 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:56.246466 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:56.248866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:56.263994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12ac48-98fe-4b22-b6a4-2c084794ca51 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:56.284918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:56.329694 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:56.331188 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:56.331487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:56.331759 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] PATH_INFO: `/v3/projects/2ea07873194049b190559552bdabe1b7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:56.332956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea07873194049b190559552bdabe1b7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:56.334891 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:56.537778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea07873194049b190559552bdabe1b7', 'request_id': 'req-3d2f21fa-3a89-45ec-be3e-3afbec009db8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:56.543439 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea07873194049b190559552bdabe1b7', 'request_id': 'req-3d2f21fa-3a89-45ec-be3e-3afbec009db8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:56.627162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea07873194049b190559552bdabe1b7', 'request_id': 'req-3d2f21fa-3a89-45ec-be3e-3afbec009db8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:56.641936 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] The token cache is being invalidate because project 2ea07873194049b190559552bdabe1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:56.642341 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:56.644078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:56.646218 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1387/2777] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:56 2022] DELETE /identity/v3/projects/2ea07873194049b190559552bdabe1b7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:56.650084 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:56.654491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:56.666920 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a438d8-150f-4058-95bb-4ca8fe170c02 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:56.724668 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:56.725309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:56.725582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:56.725846 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] PATH_INFO: `/v3/users/9ee46add135c41f6a5a6c3e9d5df663f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:56.726929 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee46add135c41f6a5a6c3e9d5df663f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:56.729103 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:56.790009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:56.791623 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:56.882387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f21fa-3a89-45ec-be3e-3afbec009db8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:56.887743 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:56.888353 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:56.888625 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:56.888892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:56.890651 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:56.903133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:56.904714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:56.915415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1388/2778] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:53:56.933392 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee46add135c41f6a5a6c3e9d5df663f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:56.934194 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee46add135c41f6a5a6c3e9d5df663f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.017045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee46add135c41f6a5a6c3e9d5df663f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.025222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee46add135c41f6a5a6c3e9d5df663f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.025862 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-163280d9-16fb-4af2-a0cb-9fac0816df2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee46add135c41f6a5a6c3e9d5df663f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.043620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1391/2779] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:56 2022] DELETE /identity/v3/users/9ee46add135c41f6a5a6c3e9d5df663f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:57.281740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:57.283167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:57.299159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfdb30-58df-4a74-bf81-c3417f29ff31 service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:57.317855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:57.356732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:57.357410 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:57.357690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:57.357957 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] PATH_INFO: `/v3/projects/14c5787e06c9423ba64b5c5dae2e346b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:57.359098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c5787e06c9423ba64b5c5dae2e346b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:57.360995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:57.475492 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c5787e06c9423ba64b5c5dae2e346b', 'request_id': 'req-320df687-601e-4629-a6af-c3cba46f2153'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.480943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c5787e06c9423ba64b5c5dae2e346b', 'request_id': 'req-320df687-601e-4629-a6af-c3cba46f2153'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.566848 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c5787e06c9423ba64b5c5dae2e346b', 'request_id': 'req-320df687-601e-4629-a6af-c3cba46f2153'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.578771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] The token cache is being invalidate because project 14c5787e06c9423ba64b5c5dae2e346b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:57.579056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.579726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-320df687-601e-4629-a6af-c3cba46f2153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:57.583594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1389/2780] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:57 2022] DELETE /identity/v3/projects/14c5787e06c9423ba64b5c5dae2e346b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:57.587014 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:57.587305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:57.587671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:57.647502 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:57.648697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:57.666614 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:57.713690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1392/2781] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:57.716037 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:57.716383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:57.716783 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:57.741536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:57.742753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:57.750953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1390/2782] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:57.755753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:57.765199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18036a-c9f6-4951-aecf-4cd8e856ab93 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:57.770645 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:57.771235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:57.771506 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:57.771769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:57.772403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:53:57.772703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:57.774312 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:57.786872 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1393/2783] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:53:57.791132 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:57.800829 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c30e8-5f24-43c7-9eea-fae9c239f5d8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:57.805508 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:57.806099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:57.808786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:57.808786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:57.808786 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:57.809315 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:57.938721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1391/2784] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:53:57 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:57.943672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:57.953983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9d593-d19c-4288-aee5-9dd4fd7eabce admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:58.012302 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:58.012896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.013170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.013465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.014075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:58.016115 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:58.135499 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1394/2785] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:53:57 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:53:58.139626 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:58.149808 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a6b0-8a71-43af-b43e-72fe5af95137 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:58.154273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:58.154859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.155134 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.155406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.156032 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:58.157843 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:58.167767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1392/2786] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:58.171746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:58.182747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dcca7-d822-436f-9da4-f2fce562a419 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:58.187403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5a39-f31e-467e-a94e-b61ee1452b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:58.187988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5a39-f31e-467e-a94e-b61ee1452b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.188267 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5a39-f31e-467e-a94e-b61ee1452b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.188537 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5a39-f31e-467e-a94e-b61ee1452b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.189169 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5a39-f31e-467e-a94e-b61ee1452b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:58.192019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5a39-f31e-467e-a94e-b61ee1452b38 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:58.202404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1395/2787] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:53:58.206712 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:58.217052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23847f86-b46f-477e-ac19-3748b00da625 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:58.222348 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:58.222987 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.223265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.223540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] PATH_INFO: `/v3/projects/94b11598c19b4a1f9ca09ba119731002/users/fa25f7bd55b8476aaa6f609caef4dd5f/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.239152 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b11598c19b4a1f9ca09ba119731002, user_id=fa25f7bd55b8476aaa6f609caef4dd5f, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:58.241865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:58.326078 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1393/2788] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:53:58 2022] PUT /identity/v3/projects/94b11598c19b4a1f9ca09ba119731002/users/fa25f7bd55b8476aaa6f609caef4dd5f/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:58.337807 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.338095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.338370 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.367500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] MFA Rules not processed for user `fa25f7bd55b8476aaa6f609caef4dd5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:58.368746 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:58.442188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1396/2789] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:58.453369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:58.455097 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:58.508076 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:58.513409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f080b-73cf-41fc-8a1d-9c49e69d1032 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:58.517140 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2874f75-fd47-4636-9dfa-77b10efc8f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:58.522177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874f75-fd47-4636-9dfa-77b10efc8f5e service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.522177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874f75-fd47-4636-9dfa-77b10efc8f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.522177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874f75-fd47-4636-9dfa-77b10efc8f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.527074 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2874f75-fd47-4636-9dfa-77b10efc8f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:58.528588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2874f75-fd47-4636-9dfa-77b10efc8f5e service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:58.538100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1394/2790] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:53:58.562258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:58.583569 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:58.627327 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3415e7-5122-44d7-a1bf-2e39fd34c7d3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:58.631968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:58.632596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.632876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.633182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] PATH_INFO: `/v3/users/fa25f7bd55b8476aaa6f609caef4dd5f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.634340 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa25f7bd55b8476aaa6f609caef4dd5f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:58.636271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:58.802855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa25f7bd55b8476aaa6f609caef4dd5f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:58.803904 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa25f7bd55b8476aaa6f609caef4dd5f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:58.862934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa25f7bd55b8476aaa6f609caef4dd5f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:58.870465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa25f7bd55b8476aaa6f609caef4dd5f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:58.871122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa25f7bd55b8476aaa6f609caef4dd5f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:58.890678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1397/2791] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:53:58 2022] DELETE /identity/v3/users/fa25f7bd55b8476aaa6f609caef4dd5f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:58.894852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:58.895131 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:58.895397 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:58.914824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:58.916017 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:58.974782 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1395/2792] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:58.984512 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:58.985943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:59.044027 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cf49e-26e2-4d3a-8d02-a371129984f6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:59.047513 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a91ed3-1e8c-4c11-9ff0-c22a75aad712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:59.048219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91ed3-1e8c-4c11-9ff0-c22a75aad712 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:59.048670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91ed3-1e8c-4c11-9ff0-c22a75aad712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:59.049179 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91ed3-1e8c-4c11-9ff0-c22a75aad712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:59.059665 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a91ed3-1e8c-4c11-9ff0-c22a75aad712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:59.061107 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a91ed3-1e8c-4c11-9ff0-c22a75aad712 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:59.071406 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1398/2793] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:53:59.584222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:59.585752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:59.598406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a17a3-67d3-462c-bde0-6ca2dbc6cac8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:59.603383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:59.604012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:59.604288 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:59.604554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] PATH_INFO: `/v3/projects/94b11598c19b4a1f9ca09ba119731002` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:59.605704 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b11598c19b4a1f9ca09ba119731002)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:59.607609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:59.749858 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b11598c19b4a1f9ca09ba119731002', 'request_id': 'req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:59.755769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b11598c19b4a1f9ca09ba119731002', 'request_id': 'req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:59.820767 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b11598c19b4a1f9ca09ba119731002', 'request_id': 'req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:59.832289 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] The token cache is being invalidate because project 94b11598c19b4a1f9ca09ba119731002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:53:59.832579 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:59.833242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3f657b8e-04c9-41d4-b911-ed0a0eed2ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:53:59.834771 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1396/2794] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:53:59 2022] DELETE /identity/v3/projects/94b11598c19b4a1f9ca09ba119731002 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:53:59.839956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:59.840486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:59.840486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:59.859956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:59.861885 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:59.899405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:53:59.919839 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1399/2795] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:59.928180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:59.928469 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:59.928745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:59.948473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:53:59.949725 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:53:59.957736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1397/2796] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:53:59.962310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:53:59.972913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642b51-5f3c-4a30-a581-d4591d44ecc5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:53:59.977617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:53:59.979947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:53:59.979947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:53:59.979947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:53:59.979947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:53:59.979947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:53:59.981256 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:53:59.993369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1400/2797] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:53:59.997732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:00.007250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3dd7-9ea6-4e8f-8e05-ad263e8f0653 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:00.011937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:00.014245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.014245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.014245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.014245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:00.015572 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:00.132789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1398/2798] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:53:59 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:54:00.136785 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:00.147283 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce493b-9fab-4657-a351-4d2c1ceb8a4f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:00.202848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:00.203445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.203721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.203992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.204620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:00.207440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:00.290815 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1401/2799] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:54:00 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:54:00.294943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:00.305422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6715f-20fb-4e9c-a579-f0a6457be7c2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:00.309962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:00.310547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.310819 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.311084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.311710 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:00.313321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:00.323313 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1399/2800] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:54:00.327345 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:00.338215 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e63975-d3d8-47d1-b3a4-237ce0312ec3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:00.342879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d106a2-dc33-4018-952a-3e7c77c4e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:00.343495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d106a2-dc33-4018-952a-3e7c77c4e4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.343770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d106a2-dc33-4018-952a-3e7c77c4e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.344037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d106a2-dc33-4018-952a-3e7c77c4e4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.344670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d106a2-dc33-4018-952a-3e7c77c4e4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:00.347113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d106a2-dc33-4018-952a-3e7c77c4e4d3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:00.358144 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1402/2801] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:54:00.362553 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:00.372546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec40328-acb7-4472-a340-f44ab14c15a3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:00.377123 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:00.377794 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.378055 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.378321 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] PATH_INFO: `/v3/projects/4386b1823dd9453baf409e80f03bfa97/users/d1b59516219049b98d40e0a541351ee1/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.393632 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4386b1823dd9453baf409e80f03bfa97, user_id=d1b59516219049b98d40e0a541351ee1, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:00.396265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:00.491994 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1400/2802] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:54:00 2022] PUT /identity/v3/projects/4386b1823dd9453baf409e80f03bfa97/users/d1b59516219049b98d40e0a541351ee1/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:54:00.503424 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.503874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.504235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.533318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] MFA Rules not processed for user `d1b59516219049b98d40e0a541351ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:54:00.534848 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:54:00.600865 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1403/2803] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:54:00.612211 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:00.614274 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:54:00.626343 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:54:00.675635 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fcbfa-7b5b-4aae-bcbe-271414b6e6b0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:00.679365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d3269-aa40-4276-b8ac-3e40e9156257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:00.679953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3269-aa40-4276-b8ac-3e40e9156257 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:00.680230 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3269-aa40-4276-b8ac-3e40e9156257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:00.680501 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3269-aa40-4276-b8ac-3e40e9156257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:00.689538 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d3269-aa40-4276-b8ac-3e40e9156257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:00.691511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d3269-aa40-4276-b8ac-3e40e9156257 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:00.700413 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1401/2804] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:54:06.967343 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:07.010134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:54:07.032008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790209-8e70-4586-a278-2f70e4bdeee9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:07.037655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:07.038286 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:07.038562 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:07.038833 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] PATH_INFO: `/v3/users/d1b59516219049b98d40e0a541351ee1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:07.039947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b59516219049b98d40e0a541351ee1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:07.041957 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:07.236724 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b59516219049b98d40e0a541351ee1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:07.237414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b59516219049b98d40e0a541351ee1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:07.271365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:07.271854 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:07.271966 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:07.291151 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] MFA Rules not processed for user `5694e0c4dda94544bad91e5b9cb13b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:54:07.294949 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:54:07.313813 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b59516219049b98d40e0a541351ee1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:07.324597 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b59516219049b98d40e0a541351ee1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:07.325307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9db3556b-09c9-4b15-90ba-385a3753a32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b59516219049b98d40e0a541351ee1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:07.346156 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1404/2805] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:54:06 2022] DELETE /identity/v3/users/d1b59516219049b98d40e0a541351ee1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:54:07.349440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1402/2806] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:54:07.355992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:07.356364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:07.356637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:07.375835 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:54:07.377045 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:54:07.439402 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1405/2807] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:54:07.449971 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:07.451395 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:54:07.533310 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7f35-ce51-4475-a0ad-9776f10884da None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:07.582617 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:07.583751 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:07.584136 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:07.584409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:07.591787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:54:07.594135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:07.595556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:07.606033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1403/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:54:08.086172 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:54:08.088441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:54:08.102266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a58f1-3af9-4102-b4e7-f3504cce7f46 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:54:08.108118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:54:08.108947 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:54:08.109369 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:54:08.109742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] PATH_INFO: `/v3/projects/4386b1823dd9453baf409e80f03bfa97` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:54:08.111095 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4386b1823dd9453baf409e80f03bfa97)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:54:08.113265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:54:08.228110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4386b1823dd9453baf409e80f03bfa97', 'request_id': 'req-2659311e-a621-4bfd-83ba-86260e158720'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:08.230693 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:54:08.325959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4386b1823dd9453baf409e80f03bfa97', 'request_id': 'req-2659311e-a621-4bfd-83ba-86260e158720'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:08.332385 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4386b1823dd9453baf409e80f03bfa97', 'request_id': 'req-2659311e-a621-4bfd-83ba-86260e158720'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:08.344284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] The token cache is being invalidate because project 4386b1823dd9453baf409e80f03bfa97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:54:08.344571 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:08.345266 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:54:08.346781 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1406/2809] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:54:08 2022] DELETE /identity/v3/projects/4386b1823dd9453baf409e80f03bfa97 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:54:17.628052 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:54:18.512214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=3,keystone:SELECT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:17.490841 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:17.492387 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:17.506702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a82c8-b160-425b-b846-fa7fafcd7b21 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:17.573742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:17.574276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:17.574554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:17.574824 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] PATH_INFO: `/v3/users/5694e0c4dda94544bad91e5b9cb13b89` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:17.575944 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5694e0c4dda94544bad91e5b9cb13b89)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:17.577906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:17.738642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5694e0c4dda94544bad91e5b9cb13b89'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:17.739303 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5694e0c4dda94544bad91e5b9cb13b89'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:17.740099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5694e0c4dda94544bad91e5b9cb13b89'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:17.747816 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5694e0c4dda94544bad91e5b9cb13b89'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:17.832238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-628e0cc9-26af-42e3-bf74-7e312ad40d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5694e0c4dda94544bad91e5b9cb13b89'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:17.852222 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1404/2810] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:55:17 2022] DELETE /identity/v3/users/5694e0c4dda94544bad91e5b9cb13b89 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:18.268357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:18.269873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:18.284118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659311e-a621-4bfd-83ba-86260e158720 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:18.342409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:18.343037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:18.343298 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:18.343593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] PATH_INFO: `/v3/projects/37653d430e7d44c88dee1e31439c4a7a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:18.344681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37653d430e7d44c88dee1e31439c4a7a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:18.346670 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:18.506845 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37653d430e7d44c88dee1e31439c4a7a', 'request_id': 'req-40f92efd-336d-4dc8-ab10-ac6f186aec64'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:18.621688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37653d430e7d44c88dee1e31439c4a7a', 'request_id': 'req-40f92efd-336d-4dc8-ab10-ac6f186aec64'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:18.628231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37653d430e7d44c88dee1e31439c4a7a', 'request_id': 'req-40f92efd-336d-4dc8-ab10-ac6f186aec64'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:18.639470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] The token cache is being invalidate because project 37653d430e7d44c88dee1e31439c4a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:55:18.639755 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:18.640404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-40f92efd-336d-4dc8-ab10-ac6f186aec64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:18.641909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1407/2811] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:55:18 2022] DELETE /identity/v3/projects/37653d430e7d44c88dee1e31439c4a7a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:18.646779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:18.647235 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:18.647345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:18.668792 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:18.670048 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:18.733186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1405/2812] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:18.741238 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:18.741599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:18.741941 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:18.763120 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:18.764593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:18.772578 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1408/2813] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:18.776958 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:18.787023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0ab7-9916-49bb-8628-c9522e2d3652 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:18.792375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:18.793246 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:18.793421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:18.793554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:18.794189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:55:18.794483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:18.796075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:18.808473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1406/2814] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:55:18.813336 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:18.824964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7340d-11a6-46a1-bc85-ddacad4d94bc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:18.829682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:18.830264 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:18.830541 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:18.830806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:18.831430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:18.833364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:18.941977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1409/2815] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:55:18 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:55:18.945867 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:18.956483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9b0d-0e12-4f74-94a2-69f79a320e57 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:18.960004 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:19.014985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.015577 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.015850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.016113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.016736 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.018722 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.118386 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1407/2816] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:55:18 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:19.123008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.133231 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04a1b5-f4ac-4302-ab5e-6ded09d61d83 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.138069 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.138655 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.138931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.139200 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.139827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.141453 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.151732 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1410/2817] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:19.155815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.165797 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d5db1-13ac-46ab-b8fd-aa69daf64751 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.171009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3dfcb-f6c2-4027-abee-81a3c2c23d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.171600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3dfcb-f6c2-4027-abee-81a3c2c23d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.171882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3dfcb-f6c2-4027-abee-81a3c2c23d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.172159 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3dfcb-f6c2-4027-abee-81a3c2c23d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.172789 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3dfcb-f6c2-4027-abee-81a3c2c23d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.174415 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3dfcb-f6c2-4027-abee-81a3c2c23d90 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.185034 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1408/2818] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:19.189098 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.199018 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52a02f-c796-4099-a805-f080746d631b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.203484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.204109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.204384 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.204647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] PATH_INFO: `/v3/projects/b7f8b9066348426e805582c1bbc42c34/users/fc6c27757c1b4b6e8b7d3e43196c7618/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.219735 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f8b9066348426e805582c1bbc42c34, user_id=fc6c27757c1b4b6e8b7d3e43196c7618, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.222405 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.294017 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1411/2819] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:19 2022] PUT /identity/v3/projects/b7f8b9066348426e805582c1bbc42c34/users/fc6c27757c1b4b6e8b7d3e43196c7618/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:19.305552 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.305835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.306102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.334302 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] MFA Rules not processed for user `fc6c27757c1b4b6e8b7d3e43196c7618`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:19.335505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:19.405148 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1409/2820] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:19.409663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.438552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:19.471129 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e2175-ef0d-4e1c-a643-28c312792133 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.475616 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.476199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.476476 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.476748 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.477403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.480019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.577468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1412/2821] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:55:19 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:19.581902 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.593256 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b7166-6e84-49b8-9780-7cec90f3d4d9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.658702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.659451 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.659616 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.659884 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.660519 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.662505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.775189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1410/2822] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:55:19 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:55:19.779515 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.790031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db396e-3a60-48b8-a996-b56015596db6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.795619 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.796206 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.796482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.796756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.797418 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.799008 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.810000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1413/2823] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:19.814375 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.820979 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:19.825204 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785feb-0a82-446f-9086-86f6af4037c8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:19.830263 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:19.830892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:19.830892 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:19.831428 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] PATH_INFO: `/v3/projects/cca3443ded414da193a2414799a600cf/users/940a1f5bf41440e29ccc1f921fbba067/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:19.849970 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca3443ded414da193a2414799a600cf, user_id=940a1f5bf41440e29ccc1f921fbba067, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:19.852609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:19.935298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1411/2824] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:19 2022] PUT /identity/v3/projects/cca3443ded414da193a2414799a600cf/users/940a1f5bf41440e29ccc1f921fbba067/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:19.939351 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:19.949712 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a414b-70b4-43a3-bd97-44c25eb63074 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:20.006414 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cd64e-5f83-49d8-acfc-8773a0842d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:20.006987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd64e-5f83-49d8-acfc-8773a0842d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:20.007271 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd64e-5f83-49d8-acfc-8773a0842d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:20.007543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd64e-5f83-49d8-acfc-8773a0842d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:20.008167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cd64e-5f83-49d8-acfc-8773a0842d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:20.009798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cd64e-5f83-49d8-acfc-8773a0842d3d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:20.020088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1414/2825] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:20.024273 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:20.034847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d183bf2-528c-4e56-8808-9cc86b21c19d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:20.039608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:20.040252 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:20.040529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:20.040800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] PATH_INFO: `/v3/projects/cca3443ded414da193a2414799a600cf/users/940a1f5bf41440e29ccc1f921fbba067/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:20.043181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca3443ded414da193a2414799a600cf, user_id=940a1f5bf41440e29ccc1f921fbba067, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:20.045997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:20.057363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1412/2826] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:20 2022] PUT /identity/v3/projects/cca3443ded414da193a2414799a600cf/users/940a1f5bf41440e29ccc1f921fbba067/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:20.067592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:20.067879 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:20.068149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:20.096963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] MFA Rules not processed for user `940a1f5bf41440e29ccc1f921fbba067`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:20.098192 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:20.165747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1415/2827] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:20.177683 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:20.179407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:20.259943 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71b773-c134-4af0-994b-da3f5cf61a96 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:20.263484 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60501b43-6362-49de-b912-012dddda40e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:20.264067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501b43-6362-49de-b912-012dddda40e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:20.264340 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501b43-6362-49de-b912-012dddda40e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:20.264605 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501b43-6362-49de-b912-012dddda40e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:20.273680 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501b43-6362-49de-b912-012dddda40e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:20.275093 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501b43-6362-49de-b912-012dddda40e2 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:20.286021 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1413/2828] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:21.199393 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:21.225516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:21.260855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87f261-4f25-40bd-9ecb-62830ebe82ab None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:21.265383 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:21.266037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:21.266307 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:21.266573 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] PATH_INFO: `/v3/users/fc6c27757c1b4b6e8b7d3e43196c7618` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:21.267658 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6c27757c1b4b6e8b7d3e43196c7618)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:21.269601 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:21.493114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6c27757c1b4b6e8b7d3e43196c7618'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:21.493783 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6c27757c1b4b6e8b7d3e43196c7618'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:21.551025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6c27757c1b4b6e8b7d3e43196c7618'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:21.558559 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6c27757c1b4b6e8b7d3e43196c7618'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:21.559191 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6c27757c1b4b6e8b7d3e43196c7618'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:21.576647 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1416/2829] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:55:21 2022] DELETE /identity/v3/users/fc6c27757c1b4b6e8b7d3e43196c7618 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:55:21.581871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:21.582330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:21.582460 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:21.602859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:21.604065 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:21.662467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1414/2830] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:21.672235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:21.675500 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:21.731141 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243115-6122-4f23-aa5c-37470bfa3897 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:21.734909 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:21.735509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:21.735786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:21.736052 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:21.745357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:21.746799 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:21.756598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1417/2831] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:55:22.148239 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:22.152532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:22.162972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742903ce-f09f-4610-93ce-edfa37eb86eb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:22.168095 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:22.168756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:22.169060 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:22.169379 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] PATH_INFO: `/v3/projects/b7f8b9066348426e805582c1bbc42c34` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:22.170699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f8b9066348426e805582c1bbc42c34)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:22.173611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:22.384912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:22.387911 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f8b9066348426e805582c1bbc42c34', 'request_id': 'req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.394167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f8b9066348426e805582c1bbc42c34', 'request_id': 'req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.495198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f8b9066348426e805582c1bbc42c34', 'request_id': 'req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.507539 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] The token cache is being invalidate because project b7f8b9066348426e805582c1bbc42c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:55:22.508025 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.512972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.512972 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1415/2832] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:55:22 2022] DELETE /identity/v3/projects/b7f8b9066348426e805582c1bbc42c34 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:22.515306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:22.525092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a0a69-e81d-48d7-87aa-af5d752183b5 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:22.567550 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:22.582199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:22.582811 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:22.583082 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:22.583344 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] PATH_INFO: `/v3/users/940a1f5bf41440e29ccc1f921fbba067` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:22.584456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=940a1f5bf41440e29ccc1f921fbba067)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:22.586472 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:22.788149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940a1f5bf41440e29ccc1f921fbba067'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.788793 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940a1f5bf41440e29ccc1f921fbba067'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.853509 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940a1f5bf41440e29ccc1f921fbba067'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.861122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940a1f5bf41440e29ccc1f921fbba067'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.861795 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e406befc-eee2-4ef2-adc2-654036db2a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940a1f5bf41440e29ccc1f921fbba067'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:22.879741 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1418/2833] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:55:22 2022] DELETE /identity/v3/users/940a1f5bf41440e29ccc1f921fbba067 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:23.285419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:23.286859 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:23.300715 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23e8c-d74a-464c-a8f8-9b94408e8b3f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:23.361931 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:23.362561 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:23.362844 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:23.363117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] PATH_INFO: `/v3/projects/cca3443ded414da193a2414799a600cf` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:23.364231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca3443ded414da193a2414799a600cf)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:23.366198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:23.506629 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca3443ded414da193a2414799a600cf', 'request_id': 'req-063bd3d4-41ed-4b30-bdce-52fe6980254a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:23.512587 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca3443ded414da193a2414799a600cf', 'request_id': 'req-063bd3d4-41ed-4b30-bdce-52fe6980254a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:23.585110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca3443ded414da193a2414799a600cf', 'request_id': 'req-063bd3d4-41ed-4b30-bdce-52fe6980254a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:23.597533 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] The token cache is being invalidate because project cca3443ded414da193a2414799a600cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:55:23.597818 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:23.598447 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-063bd3d4-41ed-4b30-bdce-52fe6980254a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:23.599927 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1416/2834] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:55:23 2022] DELETE /identity/v3/projects/cca3443ded414da193a2414799a600cf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:23.605834 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:23.606673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:23.606673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:23.627734 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:23.628924 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:23.688081 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1419/2835] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:55:23.695714 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:23.695998 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:23.696272 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:23.716517 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:23.718276 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:23.726749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1417/2836] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:23.731079 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:23.744775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad82a5-9b87-4a8e-9ca4-d47fe4f033f6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:23.745653 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:23.746236 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:23.746508 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:23.746772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:23.747404 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:55:23.747697 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:23.749397 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:23.760716 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1420/2837] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:55:23.765860 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:23.775028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3d099-b982-4103-9f39-81b5c662594e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:23.779697 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:23.780909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:23.781186 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:23.781470 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:23.782094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:23.783985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:23.885880 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1418/2838] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:55:23 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:23.890802 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:23.900745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2865019-2ed3-4130-9c3c-e4a0f1b924fc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:23.946080 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:23.955703 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:23.956288 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:23.962065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:23.962065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:23.962065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:23.962065 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.038246 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1421/2839] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:55:23 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:24.042575 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.053103 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687c8e3-4c5a-45a0-a779-e364b94b2c91 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.057745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.058334 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.058611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.058879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.059511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.061106 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.071202 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1419/2840] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:24.075165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.085743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a01bb4-ca90-4b86-977b-1e96227460f3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.090486 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9e366-abc7-4466-99f8-e543967ebc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.091058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9e366-abc7-4466-99f8-e543967ebc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.091332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9e366-abc7-4466-99f8-e543967ebc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.091598 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9e366-abc7-4466-99f8-e543967ebc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.092216 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9e366-abc7-4466-99f8-e543967ebc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.094580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9e366-abc7-4466-99f8-e543967ebc1c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.104940 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1422/2841] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:24.109389 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.120163 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48486e31-727d-414e-9313-2805caf07d15 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.125621 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.126264 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.126563 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.126835 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] PATH_INFO: `/v3/projects/c6b56354242044aabd3a6a070ed5dd2e/users/8eb58764903a4eed9d5de011bf2a769e/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.142180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b56354242044aabd3a6a070ed5dd2e, user_id=8eb58764903a4eed9d5de011bf2a769e, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.144766 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.211100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:24.215969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1420/2842] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:24 2022] PUT /identity/v3/projects/c6b56354242044aabd3a6a070ed5dd2e/users/8eb58764903a4eed9d5de011bf2a769e/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:24.227596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.227931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.228207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.256118 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] MFA Rules not processed for user `8eb58764903a4eed9d5de011bf2a769e`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:24.257341 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:24.320000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1423/2843] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:24.324698 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.387611 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a2f6-f149-4e80-a059-0ded08dfb144 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.393061 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.393631 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.393912 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.394189 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.394810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.396705 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.502238 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1421/2844] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:55:24 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:24.506467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.517411 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287b69-b507-4c6c-b327-8f26aa0bef83 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.572470 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.573061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.573367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.573636 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.574259 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.576160 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.691049 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1424/2845] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:55:24 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:24.695016 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.705369 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b2f54-44f8-4dca-bbff-0524f711705c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.709995 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.710576 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.710850 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.711116 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.712001 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.713658 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.724026 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1422/2846] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:24.730951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.742050 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbb72d-8ded-4f56-a4b8-d8b0cdbbb646 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.746586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.747255 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.747531 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.747801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] PATH_INFO: `/v3/projects/f01d6853d46847a4b9110a523edfdd35/users/19bb0c77282f4ae9aba3a2a479f59c5b/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.764403 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01d6853d46847a4b9110a523edfdd35, user_id=19bb0c77282f4ae9aba3a2a479f59c5b, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.767491 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.849953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1425/2847] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:24 2022] PUT /identity/v3/projects/f01d6853d46847a4b9110a523edfdd35/users/19bb0c77282f4ae9aba3a2a479f59c5b/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:24.853980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.864582 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5376-067b-494d-bc9f-86b1dbe87a6e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.919726 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e7836-c201-431f-9731-5eb4215b5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.920320 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7836-c201-431f-9731-5eb4215b5f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.920594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7836-c201-431f-9731-5eb4215b5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.921547 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7836-c201-431f-9731-5eb4215b5f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.922177 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e7836-c201-431f-9731-5eb4215b5f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.923746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e7836-c201-431f-9731-5eb4215b5f5e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.933077 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1423/2848] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:24.937332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:24.947534 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340bcaa-6bfe-442f-8bd7-2eff74678ce2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:24.952153 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:24.952788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.953059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.953364 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] PATH_INFO: `/v3/projects/f01d6853d46847a4b9110a523edfdd35/users/19bb0c77282f4ae9aba3a2a479f59c5b/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:24.955232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01d6853d46847a4b9110a523edfdd35, user_id=19bb0c77282f4ae9aba3a2a479f59c5b, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:24.957888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:24.968864 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1426/2849] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:24 2022] PUT /identity/v3/projects/f01d6853d46847a4b9110a523edfdd35/users/19bb0c77282f4ae9aba3a2a479f59c5b/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:55:24.978903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:24.979192 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:24.979464 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:25.007494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] MFA Rules not processed for user `19bb0c77282f4ae9aba3a2a479f59c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:25.008696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:25.067437 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:25.076105 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1424/2850] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:25.087730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:25.089426 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:25.104229 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:25.147840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d341c-f0d6-4f91-bb06-5146395ee6b7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:25.151467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:25.152061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:25.152391 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:25.152662 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:25.162015 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:25.163444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:25.175110 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1427/2851] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:25.329920 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:25.332354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:25.344420 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0246f-b621-4abd-92b1-2cbabac86741 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:25.347997 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e4111-0162-4b03-a3c7-08ae886420aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:25.348590 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e4111-0162-4b03-a3c7-08ae886420aa service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:25.348866 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e4111-0162-4b03-a3c7-08ae886420aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:25.349135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e4111-0162-4b03-a3c7-08ae886420aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:25.404764 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e4111-0162-4b03-a3c7-08ae886420aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:25.406888 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e4111-0162-4b03-a3c7-08ae886420aa service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:25.415857 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1425/2852] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:30.722683 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:30.784314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f05a2-2043-46bb-96e8-2c46f18d6bb5 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:30.789003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:30.789654 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:30.789934 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:30.790207 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] PATH_INFO: `/v3/users/8eb58764903a4eed9d5de011bf2a769e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:30.791352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb58764903a4eed9d5de011bf2a769e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:30.793306 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:30.926608 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb58764903a4eed9d5de011bf2a769e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:30.927258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb58764903a4eed9d5de011bf2a769e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:30.975011 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb58764903a4eed9d5de011bf2a769e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:30.982086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb58764903a4eed9d5de011bf2a769e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:30.982723 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb58764903a4eed9d5de011bf2a769e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:31.001071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1428/2853] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:55:30 2022] DELETE /identity/v3/users/8eb58764903a4eed9d5de011bf2a769e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:31.005573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:31.006071 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:31.006173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:31.025245 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:31.027135 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:31.084673 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1426/2854] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:31.095367 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:31.096757 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:31.131254 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:31.151750 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0d5e-cf7b-4daa-8012-57ea8c3014e6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:31.155459 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:31.156042 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:31.156313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:31.157319 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:31.166048 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:31.167456 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:31.177990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1429/2855] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:31.594079 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:31.595518 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:31.607480 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8d776-0795-40cf-8701-99d66e360d79 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:31.613882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:31.613882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:31.613882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:31.613882 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] PATH_INFO: `/v3/projects/c6b56354242044aabd3a6a070ed5dd2e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:31.615137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b56354242044aabd3a6a070ed5dd2e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:31.617155 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:31.735781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b56354242044aabd3a6a070ed5dd2e', 'request_id': 'req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:31.741487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b56354242044aabd3a6a070ed5dd2e', 'request_id': 'req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:31.843642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b56354242044aabd3a6a070ed5dd2e', 'request_id': 'req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:31.855330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] The token cache is being invalidate because project c6b56354242044aabd3a6a070ed5dd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:55:31.855619 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:31.856249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:31.857865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1427/2856] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:55:31 2022] DELETE /identity/v3/projects/c6b56354242044aabd3a6a070ed5dd2e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:31.861840 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:31.871643 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b108aec-b3fd-4a7b-8296-c5c050befd23 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:31.928974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:31.929617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:31.929893 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:31.930161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] PATH_INFO: `/v3/users/19bb0c77282f4ae9aba3a2a479f59c5b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:31.931249 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19bb0c77282f4ae9aba3a2a479f59c5b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:31.933161 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:32.158826 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19bb0c77282f4ae9aba3a2a479f59c5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:32.159377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19bb0c77282f4ae9aba3a2a479f59c5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:32.237962 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19bb0c77282f4ae9aba3a2a479f59c5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:32.245318 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19bb0c77282f4ae9aba3a2a479f59c5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:32.245943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32f312fd-67de-4991-aa7a-fb5e0c5a2073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19bb0c77282f4ae9aba3a2a479f59c5b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:32.264258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1430/2857] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:55:31 2022] DELETE /identity/v3/users/19bb0c77282f4ae9aba3a2a479f59c5b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:32.720690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:32.720690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:32.725536 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d8f82-cb7c-4bab-8d0e-5eeb7852dd6f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:32.738746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:32.785357 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:32.785985 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:32.786259 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:32.786522 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] PATH_INFO: `/v3/projects/f01d6853d46847a4b9110a523edfdd35` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:32.787677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01d6853d46847a4b9110a523edfdd35)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:32.789746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:32.918554 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01d6853d46847a4b9110a523edfdd35', 'request_id': 'req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:32.924558 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01d6853d46847a4b9110a523edfdd35', 'request_id': 'req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:33.019874 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01d6853d46847a4b9110a523edfdd35', 'request_id': 'req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:33.031458 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] The token cache is being invalidate because project f01d6853d46847a4b9110a523edfdd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:55:33.035495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:33.035495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-776109f9-c9d1-4fcd-b5f3-d7405c49efb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:33.035495 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1428/2858] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:55:32 2022] DELETE /identity/v3/projects/f01d6853d46847a4b9110a523edfdd35 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:33.039501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.039974 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.040092 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.059728 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:33.060959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:33.108423 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:33.120064 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1431/2859] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:33.128778 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.133702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.133702 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.151191 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:33.152425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:33.160440 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1429/2860] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:33.164860 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.174853 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4484-b352-4b1f-8afc-7043cdf091dc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.179353 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.179938 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.180214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.180485 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.181112 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:55:33.181451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:33.183167 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:33.195309 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1432/2861] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:55:33.199637 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.209750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc3284-c344-4e60-88e5-ccb875ad1f8e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.214681 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.219600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.219600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.219600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.219600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:33.219600 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:33.307659 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1430/2862] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:55:33 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:33.311968 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.322928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e8294-7f19-403d-9894-199fb1e045d3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.379447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.380075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.380373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.380641 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.381292 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:33.383272 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:33.523999 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1433/2863] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:55:33 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:33.528176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.538977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677aaa5-6861-4581-b35d-45460e26ed4a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.546096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.546096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.546096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.546096 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.546494 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:33.546853 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:33.557433 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1431/2864] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:33.561427 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.572253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8954f-5786-4a01-a942-eea17156cb81 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.577058 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e363977-128d-41ba-b4ca-05a74a1b4da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.577673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e363977-128d-41ba-b4ca-05a74a1b4da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.577951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e363977-128d-41ba-b4ca-05a74a1b4da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.578219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e363977-128d-41ba-b4ca-05a74a1b4da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.579010 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e363977-128d-41ba-b4ca-05a74a1b4da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:33.580631 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e363977-128d-41ba-b4ca-05a74a1b4da1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:33.591452 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1434/2865] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:33.595904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.605838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaba58-9c53-4b09-8d3b-860a2445b94c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.611087 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.611746 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.612028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.612292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] PATH_INFO: `/v3/projects/afe714c36ba54d7fb1cdc01f2cfad2dd/users/ddf3fb15703842f6b1918e67d976c1be/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.629491 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe714c36ba54d7fb1cdc01f2cfad2dd, user_id=ddf3fb15703842f6b1918e67d976c1be, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:33.632242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:33.754373 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1432/2866] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:33 2022] PUT /identity/v3/projects/afe714c36ba54d7fb1cdc01f2cfad2dd/users/ddf3fb15703842f6b1918e67d976c1be/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:33.819067 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30684-3e81-4972-9236-155e18559fbc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.819262 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30684-3e81-4972-9236-155e18559fbc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.819503 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30684-3e81-4972-9236-155e18559fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.849022 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-05f30684-3e81-4972-9236-155e18559fbc None None] MFA Rules not processed for user `ddf3fb15703842f6b1918e67d976c1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:33.850250 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-05f30684-3e81-4972-9236-155e18559fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:33.913021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1435/2867] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:33.925790 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:33.927521 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:33.974814 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:33.986225 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0be69-09a4-4a43-9b9f-2101039850fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:33.989763 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eff646-8cdd-4d58-a56b-ef8821726a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:33.990360 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff646-8cdd-4d58-a56b-ef8821726a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:33.990639 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff646-8cdd-4d58-a56b-ef8821726a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:33.990953 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff646-8cdd-4d58-a56b-ef8821726a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:33.999042 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eff646-8cdd-4d58-a56b-ef8821726a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:34.000889 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eff646-8cdd-4d58-a56b-ef8821726a89 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:34.011114 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1433/2868] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:43.910488 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:44.067504 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:45.517013 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30684-3e81-4972-9236-155e18559fbc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:45.581235 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30684-3e81-4972-9236-155e18559fbc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:45.585930 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:45.586543 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:45.586814 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:45.587093 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] PATH_INFO: `/v3/users/ddf3fb15703842f6b1918e67d976c1be` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:45.588428 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf3fb15703842f6b1918e67d976c1be)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:45.590380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:45.823284 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf3fb15703842f6b1918e67d976c1be'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:45.823935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf3fb15703842f6b1918e67d976c1be'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:45.906564 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf3fb15703842f6b1918e67d976c1be'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:45.914990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf3fb15703842f6b1918e67d976c1be'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:45.915666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf3fb15703842f6b1918e67d976c1be'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:45.932745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1436/2869] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:55:45 2022] DELETE /identity/v3/users/ddf3fb15703842f6b1918e67d976c1be => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:45.937311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:45.937847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:45.937847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:45.957550 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:45.958739 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:46.017419 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1434/2870] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:46.027787 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:46.029234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:46.085620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9adb-1b1b-4a96-bdf8-e36b8bf2636e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:46.089454 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d401c36-41b4-4f0b-aa95-15d46a923dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:46.090039 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401c36-41b4-4f0b-aa95-15d46a923dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:46.090322 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401c36-41b4-4f0b-aa95-15d46a923dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:46.090591 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401c36-41b4-4f0b-aa95-15d46a923dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:46.099949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d401c36-41b4-4f0b-aa95-15d46a923dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:46.101420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d401c36-41b4-4f0b-aa95-15d46a923dc5 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:46.110666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1437/2871] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:46.572203 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:46.573833 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:46.586198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2989e-4165-432e-857b-6b32921ecc36 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:46.592787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:46.593483 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:46.596285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:46.596285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] PATH_INFO: `/v3/projects/afe714c36ba54d7fb1cdc01f2cfad2dd` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:46.596285 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe714c36ba54d7fb1cdc01f2cfad2dd)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:46.597292 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:46.736092 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe714c36ba54d7fb1cdc01f2cfad2dd', 'request_id': 'req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:46.742394 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe714c36ba54d7fb1cdc01f2cfad2dd', 'request_id': 'req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:46.838473 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe714c36ba54d7fb1cdc01f2cfad2dd', 'request_id': 'req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:46.849945 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] The token cache is being invalidate because project afe714c36ba54d7fb1cdc01f2cfad2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:55:46.853319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:46.853319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bed04f90-0caf-4631-8ab8-b0a0ddc8d925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:55:46.853319 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1435/2872] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:55:46 2022] DELETE /identity/v3/projects/afe714c36ba54d7fb1cdc01f2cfad2dd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:46.857838 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:46.858305 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:46.858409 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:46.878222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:46.880000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:46.896769 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:46.938113 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1438/2873] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:46.946121 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:46.946643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:46.946643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:46.966896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:46.969864 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:46.983015 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1436/2874] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:46.987332 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:46.998031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9f93-40e9-47a0-9654-907d11d3a8ab None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.002580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.003168 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.003441 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.003730 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.004371 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:55:47.004671 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.006320 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.017739 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1439/2875] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:55:47.022198 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:47.031339 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e9abb-f57c-4f62-bb39-16ba8d4c9a2a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.036591 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.037170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.037477 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.037745 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.038372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.040250 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.136115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1437/2876] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:55:47 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:55:47.140165 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:47.150381 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6cb6a-8045-437c-9314-e0dfb3bd784a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.206217 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.206810 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.207149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.207420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.208044 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.210005 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.289935 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1440/2877] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:55:47 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:55:47.295110 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:47.306753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3872-0b50-420b-8702-3845a4ceb781 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.311412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.311982 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.312257 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.312524 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.313150 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.314753 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.324638 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1438/2878] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:47.328690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:47.339682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de441eb7-3b65-4493-846d-62898dca7760 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.344539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f4b8-1b70-4b7d-8384-fc4680ea6608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.345126 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f4b8-1b70-4b7d-8384-fc4680ea6608 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.345433 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f4b8-1b70-4b7d-8384-fc4680ea6608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.348314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f4b8-1b70-4b7d-8384-fc4680ea6608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.348314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f4b8-1b70-4b7d-8384-fc4680ea6608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.348727 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f4b8-1b70-4b7d-8384-fc4680ea6608 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.359953 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1441/2879] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:55:47.364167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:47.374117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d9cca-029f-47d8-8cbe-96b6bf1e645c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.378609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.379242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.379509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.379779 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] PATH_INFO: `/v3/projects/a68e877682ef4dedac0eca15d3b35c21/users/53b0553563d94c8590a6bdbc93e922b6/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.395607 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68e877682ef4dedac0eca15d3b35c21, user_id=53b0553563d94c8590a6bdbc93e922b6, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.398535 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.455327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1439/2880] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:55:47 2022] PUT /identity/v3/projects/a68e877682ef4dedac0eca15d3b35c21/users/53b0553563d94c8590a6bdbc93e922b6/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:55:47.460979 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e6438-d05f-4eb6-a95b-dff66b073533 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.461294 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e6438-d05f-4eb6-a95b-dff66b073533 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.461592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e6438-d05f-4eb6-a95b-dff66b073533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.481554 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3f3e6438-d05f-4eb6-a95b-dff66b073533 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:47.482794 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3f3e6438-d05f-4eb6-a95b-dff66b073533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:47.542720 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1442/2881] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:47.552354 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:47.554044 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:47.567467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:47.611113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c229c-3c2b-4c4a-9f83-b0749dfaa9fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:47.615028 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:47.615689 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:47.616115 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:47.616805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:47.626117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:47.627992 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:47.637540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1440/2882] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:48.943000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795683-40e8-4447-a43c-962b46bbfbca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:48.943587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795683-40e8-4447-a43c-962b46bbfbca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:48.943587 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2795683-40e8-4447-a43c-962b46bbfbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:48.971997 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f2795683-40e8-4447-a43c-962b46bbfbca None None] MFA Rules not processed for user `53b0553563d94c8590a6bdbc93e922b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:48.973859 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2795683-40e8-4447-a43c-962b46bbfbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:48.990992 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:55:49.042059 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1443/2883] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:55:49.052868 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:49.054412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:49.111980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdff66-68d7-4f93-ae43-9802ff86afc7 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:49.115809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732932-6438-4185-864f-0a121018b985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd02a5e02723a4c29ad8872f269138453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:49.116398 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732932-6438-4185-864f-0a121018b985 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:49.116671 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732932-6438-4185-864f-0a121018b985 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:49.116934 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732932-6438-4185-864f-0a121018b985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:49.125099 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732932-6438-4185-864f-0a121018b985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:49.126545 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732932-6438-4185-864f-0a121018b985 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:49.135556 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1441/2884] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:50.904959 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:50.905599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:50.905599 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:50.925105 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] MFA Rules not processed for user `53b0553563d94c8590a6bdbc93e922b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:55:50.926976 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:50.934070 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1444/2885] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:55:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:55:54.007383 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732932-6438-4185-864f-0a121018b985 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:54.008781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-63732932-6438-4185-864f-0a121018b985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:54.020498 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732932-6438-4185-864f-0a121018b985 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:54.024904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:54.025588 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:54.025865 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:54.026128 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:54.027805 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:54.115815 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:54.117258 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d149a62-6f5d-463d-845a-47a7a927296c service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:54.137661 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1442/2886] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:55:55.251440 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:55:55.261763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb09fc-067c-49c6-a71f-e49aa3c127bd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:55:55.265291 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:55:55.267951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:55:55.267951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:55:55.267951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:55:55.268240 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:55:55.281465 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:55:55.282890 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:55:55.301484 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1445/2887] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:55:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:04.135176 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:56:05.289763 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=28 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:56:23.618409 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884458e-15fb-4f94-8764-cc73a2c170cc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:23.618956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884458e-15fb-4f94-8764-cc73a2c170cc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:23.618956 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884458e-15fb-4f94-8764-cc73a2c170cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:23.639940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c884458e-15fb-4f94-8764-cc73a2c170cc None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:23.643371 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c884458e-15fb-4f94-8764-cc73a2c170cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:23.649365 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1443/2888] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:23.676061 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:23.677468 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:23.692170 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3c5ae-07f3-4bf9-bec8-b3dc103a6059 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:23.697637 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:23.698218 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:23.698489 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:23.698753 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:23.707377 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:23.708933 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:23.718943 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1446/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:27.850335 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1e64-b3b3-4303-9013-cda420be861a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:27.850879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1e64-b3b3-4303-9013-cda420be861a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:27.850879 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1e64-b3b3-4303-9013-cda420be861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:27.871852 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bd7e1e64-b3b3-4303-9013-cda420be861a None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:27.873046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bd7e1e64-b3b3-4303-9013-cda420be861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:27.880968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1444/2890] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:27.901420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:27.903496 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:27.918314 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b907d-74d3-4691-b10c-032310d8a1c9 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:27.925928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:27.925928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:27.925928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:27.925928 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:27.932881 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:27.934688 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:27.944134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1447/2891] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:31.369551 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8ea6-524a-40b2-8659-ab72ed8ae379 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:31.370130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8ea6-524a-40b2-8659-ab72ed8ae379 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:31.370130 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb8ea6-524a-40b2-8659-ab72ed8ae379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:31.390100 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-eabb8ea6-524a-40b2-8659-ab72ed8ae379 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:31.391327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eabb8ea6-524a-40b2-8659-ab72ed8ae379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:31.399280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1445/2892] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:31.421988 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:31.433242 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cb510-02da-49f1-9182-7f350a0a4fc1 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:31.438964 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:31.439589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:31.439868 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:31.440136 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:31.448222 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:31.450412 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:31.459801 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1448/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:34.247430 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58e75-7f27-4d5d-9819-f97b4174a2dd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:34.247980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58e75-7f27-4d5d-9819-f97b4174a2dd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:34.247980 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58e75-7f27-4d5d-9819-f97b4174a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:34.268968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9ae58e75-7f27-4d5d-9819-f97b4174a2dd None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:34.270330 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9ae58e75-7f27-4d5d-9819-f97b4174a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:34.279326 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1446/2894] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:34.311629 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:34.323213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1f57-3b56-4a46-a8a7-02f1fa763e3f service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:34.330114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:34.331019 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:34.331521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:34.332003 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:34.342937 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:34.344774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:34.355858 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1449/2895] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:37.485700 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14006-68af-411c-ac39-d1c3785cd75f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:37.486199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14006-68af-411c-ac39-d1c3785cd75f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:37.486300 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14006-68af-411c-ac39-d1c3785cd75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:37.506269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-69c14006-68af-411c-ac39-d1c3785cd75f None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:37.507456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-69c14006-68af-411c-ac39-d1c3785cd75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:37.515179 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1447/2896] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:37.536375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:37.548012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2e95-3bc3-4120-b1b4-5700352b2b49 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:37.553589 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:37.554182 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:37.554455 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:37.554738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:37.563726 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:37.565334 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:37.574806 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1450/2897] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:40.740311 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:40.740828 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:40.740946 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:40.760041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:40.761242 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:40.769165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1448/2898] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:40.814495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:40.825949 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5e728-30e1-44fa-9974-9c2847f01629 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:40.831906 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844982d4-81b7-4aa6-818c-d41ba048e357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:40.832495 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844982d4-81b7-4aa6-818c-d41ba048e357 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:40.832770 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844982d4-81b7-4aa6-818c-d41ba048e357 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:40.833068 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844982d4-81b7-4aa6-818c-d41ba048e357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:40.841582 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844982d4-81b7-4aa6-818c-d41ba048e357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:40.844139 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844982d4-81b7-4aa6-818c-d41ba048e357 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:40.853678 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1451/2899] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:50.754781 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=18 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:56:50.849439 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=36 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:56:50.913094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:50.925137 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1556-10a3-49ea-bb63-bb6403d90b57 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:50.930597 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:50.931185 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:50.931643 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:50.931910 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:50.933636 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:50.946899 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:50.948467 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:50.959033 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1449/2900] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:56:57.085382 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:57.085889 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:57.085998 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:57.104778 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] MFA Rules not processed for user `53b0553563d94c8590a6bdbc93e922b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:56:57.105993 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:57.113467 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1452/2901] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:56:57.784181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:56:57.785926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:57.860952 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63b436-0588-483d-b38a-59e636749416 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:56:57.866606 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:56:57.867210 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:56:57.867487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:56:57.867757 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:56:57.869546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:56:57.883981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:56:57.885541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:56:57.900541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1450/2902] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:56:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:01.093547 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:01.103313 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fb03-6dcb-467a-8f84-c562609d45d4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:01.106874 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:01.107466 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:01.107738 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:01.108025 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:01.109743 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:01.119832 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:01.121274 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d62b-4724-4d64-81cd-e89e0e75c177 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:01.130557 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1453/2903] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:07.893720 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=38 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:08.175541 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:08.188509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654512b-3288-442b-95c3-350cb05f132d service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:08.198690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:08.198690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:08.198690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:08.198690 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:08.199173 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:08.209327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:08.210909 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:08.222592 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1451/2904] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:11.126786 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=9 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:14.466289 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db005c-5923-46e6-8e68-81f5dfd10d0d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:14.466969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db005c-5923-46e6-8e68-81f5dfd10d0d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:14.466969 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db005c-5923-46e6-8e68-81f5dfd10d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:14.486913 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e1db005c-5923-46e6-8e68-81f5dfd10d0d None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:14.488219 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e1db005c-5923-46e6-8e68-81f5dfd10d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:14.495973 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1454/2905] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:57:14.544453 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:14.556479 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b85b-7da1-4e4a-bc7d-7d5984e01949 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:14.561846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:14.562463 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:14.562747 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:14.563012 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:14.571688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:14.573260 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:14.582887 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1452/2906] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:17.877779 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc69de-79d2-4b99-909e-e79fede351a5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:17.878380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc69de-79d2-4b99-909e-e79fede351a5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:17.878380 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc69de-79d2-4b99-909e-e79fede351a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:17.898663 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d6cc69de-79d2-4b99-909e-e79fede351a5 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:17.899772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6cc69de-79d2-4b99-909e-e79fede351a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:17.908154 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1455/2907] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:57:17.927509 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:17.938677 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7435f1-930a-4a00-9064-6d812ad0ce67 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:17.944903 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:17.945642 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:17.945918 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:17.946187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:17.955468 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:17.957180 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:17.967559 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1453/2908] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:20.760852 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9b2f5-3175-4836-a029-020227b09451 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:20.761430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9b2f5-3175-4836-a029-020227b09451 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:20.761430 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9b2f5-3175-4836-a029-020227b09451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:20.781521 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f1e9b2f5-3175-4836-a029-020227b09451 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:20.782873 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f1e9b2f5-3175-4836-a029-020227b09451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:20.795148 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1456/2909] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:57:20.817436 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:20.828823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d65da-a08a-41b5-8ba2-8db2b1c03169 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:20.834855 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:20.835431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:20.835703 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:20.835969 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:20.844364 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:20.845999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:20.855537 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1454/2910] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:23.960245 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d45b-cc58-444d-8f89-7c7e5e223b02 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:23.960775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d45b-cc58-444d-8f89-7c7e5e223b02 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:23.960775 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d45b-cc58-444d-8f89-7c7e5e223b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:23.980290 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3118d45b-cc58-444d-8f89-7c7e5e223b02 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:23.981497 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3118d45b-cc58-444d-8f89-7c7e5e223b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:23.989199 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1457/2911] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:57:24.018648 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:24.029919 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd0bee-c3ad-4dea-94b2-cc55a8d97e5b service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:24.036377 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:24.036961 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:24.037269 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:24.037540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:24.045676 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:24.047247 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:24.056630 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1455/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:57:27.216918 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:27.217520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:27.217520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:27.237057 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:27.238265 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:27.245983 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1458/2913] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Sep 9 11:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:57:27.267542 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:27.278699 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906f56f-bec6-42ec-b750-51090f4162d7 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:27.284062 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:27.284645 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:27.284921 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:27.285187 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:27.293133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:27.294732 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:27.304825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1456/2914] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:37.231335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=15 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:37.300461 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=36 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:57:59.041501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:59.059277 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0189-ee21-43fb-93ae-675145853cf7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:59.064888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:59.065525 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.065842 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.066109 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.068029 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:57:59.081627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:59.083303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:59.095745 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1459/2915] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:57:59.160711 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:59.176813 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7071-628d-4b75-8dce-11f8cee19a77 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:59.178749 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:59.179448 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.179654 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.179928 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] PATH_INFO: `/v3/users/53b0553563d94c8590a6bdbc93e922b6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.181718 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b0553563d94c8590a6bdbc93e922b6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:59.183713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:59.320422 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b0553563d94c8590a6bdbc93e922b6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.321018 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b0553563d94c8590a6bdbc93e922b6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.321999 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b0553563d94c8590a6bdbc93e922b6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.330713 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b0553563d94c8590a6bdbc93e922b6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.369664 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-53f7ff8d-6405-4f7d-80f8-b2b9e89522dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b0553563d94c8590a6bdbc93e922b6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.391201 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1457/2916] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 11:57:59 2022] DELETE /identity/v3/users/53b0553563d94c8590a6bdbc93e922b6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:57:59.675247 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:57:59.690149 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191e60-995e-4c3f-8def-06dc3b829fbf service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:57:59.751900 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:57:59.752524 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.752800 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.753062 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] PATH_INFO: `/v3/projects/a68e877682ef4dedac0eca15d3b35c21` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.754188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68e877682ef4dedac0eca15d3b35c21)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:57:59.756088 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:57:59.856596 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68e877682ef4dedac0eca15d3b35c21', 'request_id': 'req-f7c113fd-35aa-4641-9fbb-0b592541cfdd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.930024 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68e877682ef4dedac0eca15d3b35c21', 'request_id': 'req-f7c113fd-35aa-4641-9fbb-0b592541cfdd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.936214 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68e877682ef4dedac0eca15d3b35c21', 'request_id': 'req-f7c113fd-35aa-4641-9fbb-0b592541cfdd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.947184 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] The token cache is being invalidate because project a68e877682ef4dedac0eca15d3b35c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:57:59.947464 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.948077 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f7c113fd-35aa-4641-9fbb-0b592541cfdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:57:59.949594 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1460/2917] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 11:57:59 2022] DELETE /identity/v3/projects/a68e877682ef4dedac0eca15d3b35c21 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:57:59.955363 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:57:59.955656 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:57:59.955930 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:57:59.976540 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:57:59.977800 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:00.038740 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1458/2918] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:00.047942 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.048445 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.048552 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.067997 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:00.069188 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:00.077667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1461/2919] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:00.081929 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.092488 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751765fa-4b00-43d2-9efe-4e011521e0fe None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.097010 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.097630 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.097906 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.098175 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.098811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:58:00.099107 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.100685 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.112181 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1459/2920] 10.222.0.64 () {58 vars in 1153 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:58:00.116480 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.126280 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02493395-b184-4189-adb4-9136eafa2e98 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.130982 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.131574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.131855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.132127 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.132759 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.134827 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.256798 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1462/2921] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:58:00 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:58:00.260776 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.272548 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e587f83-9f8c-487d-8633-13124457e7aa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.329691 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.330295 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.330573 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.330847 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.331481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.333416 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.341525 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:00.460896 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1460/2922] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:58:00 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:00.465150 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.475987 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b185fe2-f2ab-4507-91b2-fba3815f4dc3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.480675 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.481299 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.481579 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.481855 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.482905 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.484516 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.494620 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1463/2923] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:58:00.499023 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.511846 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9d34-ba1b-40ce-b769-fb5c2205a648 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.514231 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cc98b-dd3f-4c61-ba20-50f435b9b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.514823 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc98b-dd3f-4c61-ba20-50f435b9b7df admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.515102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc98b-dd3f-4c61-ba20-50f435b9b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.515374 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc98b-dd3f-4c61-ba20-50f435b9b7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.516002 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cc98b-dd3f-4c61-ba20-50f435b9b7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.517613 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cc98b-dd3f-4c61-ba20-50f435b9b7df admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.527954 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1461/2924] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:58:00.532241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.541939 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f419b-9214-4846-b313-df074dae4c66 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.546331 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.546977 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.547232 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.547501 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] PATH_INFO: `/v3/projects/bc4845b395034c30a6df557917b3b6eb/users/79dae56a1c9a4e09a97a6aed3b1c1a05/roles/1b11b6b4c5ef4fb99f930f82af2a2421` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.563821 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4845b395034c30a6df557917b3b6eb, user_id=79dae56a1c9a4e09a97a6aed3b1c1a05, role_id=1b11b6b4c5ef4fb99f930f82af2a2421)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.566721 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.661857 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1464/2925] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:58:00 2022] PUT /identity/v3/projects/bc4845b395034c30a6df557917b3b6eb/users/79dae56a1c9a4e09a97a6aed3b1c1a05/roles/1b11b6b4c5ef4fb99f930f82af2a2421 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:00.667084 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070171e2-cfec-4355-a93d-6e26f5128bc7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.667372 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070171e2-cfec-4355-a93d-6e26f5128bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.667644 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070171e2-cfec-4355-a93d-6e26f5128bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.687856 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-070171e2-cfec-4355-a93d-6e26f5128bc7 None None] MFA Rules not processed for user `370ac9ef52ea4ad6930fdc193054ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:00.689347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-070171e2-cfec-4355-a93d-6e26f5128bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:00.749406 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1462/2926] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:00.758903 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:00.760574 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:00.774789 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:00.816990 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a89df-bea9-4e9d-a1d2-55ad379643f6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:00.820774 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:00.821479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:00.821756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:00.822023 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:00.831152 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:00.833073 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:00.843193 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1465/2927] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:58:05.829981 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.830456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.830456 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.864809 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] MFA Rules not processed for user `79dae56a1c9a4e09a97a6aed3b1c1a05`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:05.866721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:05.956279 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1463/2928] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:05.960742 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:05.973357 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ae6ac-9459-4cd9-a5d5-c24a3c7c57cf service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:05.980303 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:05.981026 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:05.981420 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:05.981805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:05.982586 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:05.984664 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.082600 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1466/2929] 10.222.0.64 () {60 vars in 1153 bytes} [Fri Sep 9 11:58:05 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:06.086249 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:06.099735 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5101-e1f0-44ec-ab2b-3d366a5bf7c8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:06.170583 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:06.171197 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.171487 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.171754 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.172407 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:06.174421 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.251081 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:06.257432 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1464/2930] 10.222.0.64 () {60 vars in 1144 bytes} [Fri Sep 9 11:58:06 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:58:06.261395 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:06.273747 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5262a-16a5-4eb2-939c-ed254c9e89a2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:06.278581 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:06.279687 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.279966 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.280234 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.280876 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:06.282549 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.293251 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1467/2931] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:58:06.297962 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:06.307589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb12b-14a7-4806-9cce-211970b7d769 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:06.313412 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:06.314041 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.314317 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.314585 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] PATH_INFO: `/v3/projects/6efbe0854bd74519afa7bd60008521ac/users/5bdbfe4bdcf547158f5bff13cb6dcbb1/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.330811 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efbe0854bd74519afa7bd60008521ac, user_id=5bdbfe4bdcf547158f5bff13cb6dcbb1, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:06.333562 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.422446 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1465/2932] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:58:06 2022] PUT /identity/v3/projects/6efbe0854bd74519afa7bd60008521ac/users/5bdbfe4bdcf547158f5bff13cb6dcbb1/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:58:06.426532 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:06.437667 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4882-c76b-464c-b669-9c5eee69da8c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:06.496888 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd4c89-3c1c-4c33-85bb-453f098d133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:06.498075 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd4c89-3c1c-4c33-85bb-453f098d133e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.498415 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd4c89-3c1c-4c33-85bb-453f098d133e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.498681 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd4c89-3c1c-4c33-85bb-453f098d133e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.499310 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd4c89-3c1c-4c33-85bb-453f098d133e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:06.500955 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd4c89-3c1c-4c33-85bb-453f098d133e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.510756 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1468/2933] 10.222.0.64 () {58 vars in 1122 bytes} [Fri Sep 9 11:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:58:06.515608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:06.525810 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d8baf-8a3b-4a7a-9111-43f1565eb11f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:06.530347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:06.530989 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:06.531265 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:06.531532 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] PATH_INFO: `/v3/projects/6efbe0854bd74519afa7bd60008521ac/users/5bdbfe4bdcf547158f5bff13cb6dcbb1/roles/137cd8e0839747668eef67677a0171b5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:06.533489 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efbe0854bd74519afa7bd60008521ac, user_id=5bdbfe4bdcf547158f5bff13cb6dcbb1, role_id=137cd8e0839747668eef67677a0171b5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:06.536113 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:06.546327 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1466/2934] 10.222.0.64 () {60 vars in 1483 bytes} [Fri Sep 9 11:58:06 2022] PUT /identity/v3/projects/6efbe0854bd74519afa7bd60008521ac/users/5bdbfe4bdcf547158f5bff13cb6dcbb1/roles/137cd8e0839747668eef67677a0171b5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:58:12.405808 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae2798-5f23-4f0f-b675-a1f52fb64c4b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.406326 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae2798-5f23-4f0f-b675-a1f52fb64c4b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.406451 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae2798-5f23-4f0f-b675-a1f52fb64c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.437749 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7aae2798-5f23-4f0f-b675-a1f52fb64c4b None None] MFA Rules not processed for user `5bdbfe4bdcf547158f5bff13cb6dcbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:12.439138 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7aae2798-5f23-4f0f-b675-a1f52fb64c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:12.517580 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1469/2935] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:12.532046 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:12.533812 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:12.617752 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be877-3be0-430a-b008-8c7d3bb71772 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:12.621337 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f69a6b87a274ca3b4d658080992abb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:12.621940 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.622817 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.623102 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.679825 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:12.681298 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:12.690876 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1467/2936] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:58:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:58:12.937715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d689-6e01-4114-aab6-12ad7771ed78 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:12.944348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d689-6e01-4114-aab6-12ad7771ed78 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:12.944348 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d689-6e01-4114-aab6-12ad7771ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:12.944902 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.005000 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8476d689-6e01-4114-aab6-12ad7771ed78 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:13.006239 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8476d689-6e01-4114-aab6-12ad7771ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:13.072208 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1470/2937] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:13.196688 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:13.198199 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:13.262133 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:13.296138 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b30a3a-e5af-4240-9968-a5c2c6efbe76 service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:13.301170 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:13.301799 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:13.302075 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:13.302344 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:13.311162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:13.312742 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:13.321169 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1468/2938] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:58:23.072134 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=42 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:23.341897 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=16 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:24.128627 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e67f72-7121-401f-be40-b2a70387a3bb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.129122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e67f72-7121-401f-be40-b2a70387a3bb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.129258 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e67f72-7121-401f-be40-b2a70387a3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.148159 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-75e67f72-7121-401f-be40-b2a70387a3bb None None] MFA Rules not processed for user `79dae56a1c9a4e09a97a6aed3b1c1a05`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:24.149386 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-75e67f72-7121-401f-be40-b2a70387a3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:24.156539 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1471/2939] 10.222.0.64 () {58 vars in 958 bytes} [Fri Sep 9 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:24.413529 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:24.414938 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:24.471707 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480bf9e-af64-4c19-bfdb-0b193915fa90 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:24.475165 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:24.475756 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:24.476035 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:24.476345 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:24.478063 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:24.488067 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:24.489505 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:24.497478 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1469/2940] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:58:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:58:32.969037 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:32.996710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:32.996710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:32.996710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:58:32.996710 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:32.998263 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1472/2941] 10.222.0.64 () {58 vars in 1009 bytes} [Fri Sep 9 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:58:33.010515 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:33.023215 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751d1d-bcfe-4381-8667-654187bfad36 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:33.028485 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:33.029171 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:33.033167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:33.033167 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:33.037904 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:33.039474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:33.049069 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1470/2942] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 11:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 11:58:42.983699 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:43.044838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=32 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:58:55.086213 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:55.096035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a39553-1657-41c3-b3a0-31d0d0fd8224 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:55.099666 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f342c15c234b4d6592404de7e7bee866', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:55.100257 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:55.100535 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:55.100805 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:55.109797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:55.111253 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:55.120951 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1473/2943] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:58:57.114557 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:57.116721 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:57.197024 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d944b-8d9d-4598-9972-d25c9b2802cc service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:57.202610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f354bf4e63d949ecbb86b123a7022293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:57.203208 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:57.203481 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:57.203750 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:57.205511 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:57.218937 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:57.220594 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b56a9-a67f-4dee-af31-7103e6b6573c service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:57.231883 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1471/2944] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:58:59.096679 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:58:59.098035 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:59.171617 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1975a3-f547-44cd-bfce-ff90a2dbf250 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:58:59.176772 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:58:59.177408 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:58:59.177685 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:58:59.177956 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:58:59.179672 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:58:59.191410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:58:59.192991 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:58:59.203282 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1474/2945] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 11:58:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:59:07.227072 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=34 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:09.198682 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=38 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:22.564610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:22.564610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:22.564610 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:22.583347 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] MFA Rules not processed for user `cce8fd8a8e2547979eb2df2ad0bc6218`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 12:00:22.584578 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:22.591768 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1472/2946] 10.222.0.64 () {58 vars in 967 bytes} [Fri Sep 9 12:00:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 12:00:22.632767 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:22.645447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac281c-c14b-4220-9d21-54aa8a5d237a service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:22.650373 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ff1707eb264477b0a120e10c5d7a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:22.650963 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:22.651241 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:22.651536 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:22.659447 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:22.661021 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:22.669086 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1475/2947] 10.222.0.64 () {60 vars in 1384 bytes} [Fri Sep 9 12:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 12:00:27.092085 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:27.094098 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:27.110926 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb98c3-7ccb-4630-95f8-2455bfc0bacc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:27.115851 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:27.116589 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:27.116871 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:27.117146 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:27.119094 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:27.131381 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:27.133031 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:27.143836 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1473/2948] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:30.660639 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:30.725715 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdb44-3878-44cf-b7c1-53377b0f65ae service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:30.730520 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:30.731137 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:30.731416 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:30.731690 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] PATH_INFO: `/v3/users/79dae56a1c9a4e09a97a6aed3b1c1a05` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:30.732788 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dae56a1c9a4e09a97a6aed3b1c1a05)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:30.734754 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:30.931012 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dae56a1c9a4e09a97a6aed3b1c1a05'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:30.931566 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dae56a1c9a4e09a97a6aed3b1c1a05'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:30.980071 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dae56a1c9a4e09a97a6aed3b1c1a05'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:30.987335 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dae56a1c9a4e09a97a6aed3b1c1a05'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:30.988031 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dae56a1c9a4e09a97a6aed3b1c1a05'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.005114 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1476/2949] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 12:00:30 2022] DELETE /identity/v3/users/79dae56a1c9a4e09a97a6aed3b1c1a05 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:00:31.222162 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:31.234027 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2591b-5d64-475b-87a3-32a959621cc6 service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:31.293474 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:31.294143 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:31.294425 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:31.294696 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] PATH_INFO: `/v3/projects/bc4845b395034c30a6df557917b3b6eb` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:31.295838 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4845b395034c30a6df557917b3b6eb)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:31.297787 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:31.420950 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4845b395034c30a6df557917b3b6eb', 'request_id': 'req-e1d0c9e5-461d-4236-accd-6eeb86016551'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.426608 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4845b395034c30a6df557917b3b6eb', 'request_id': 'req-e1d0c9e5-461d-4236-accd-6eeb86016551'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.540280 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4845b395034c30a6df557917b3b6eb', 'request_id': 'req-e1d0c9e5-461d-4236-accd-6eeb86016551'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.553066 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] The token cache is being invalidate because project bc4845b395034c30a6df557917b3b6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:00:31.556717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.556717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.556717 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1474/2950] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 12:00:31 2022] DELETE /identity/v3/projects/bc4845b395034c30a6df557917b3b6eb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:00:31.560028 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:31.561482 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:31.574610 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aaee2-d8a4-49f3-bb0d-d47cfd832028 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:31.632040 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:31.632696 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:31.632971 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:31.633268 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] PATH_INFO: `/v3/users/5bdbfe4bdcf547158f5bff13cb6dcbb1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:31.634437 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdbfe4bdcf547158f5bff13cb6dcbb1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:31.636529 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:31.641896 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:31.799365 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdbfe4bdcf547158f5bff13cb6dcbb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.800033 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdbfe4bdcf547158f5bff13cb6dcbb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.859410 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdbfe4bdcf547158f5bff13cb6dcbb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.866673 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdbfe4bdcf547158f5bff13cb6dcbb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.867297 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdbfe4bdcf547158f5bff13cb6dcbb1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:31.884592 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1477/2951] 10.222.0.64 () {58 vars in 1224 bytes} [Fri Sep 9 12:00:31 2022] DELETE /identity/v3/users/5bdbfe4bdcf547158f5bff13cb6dcbb1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:00:32.176009 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:00:32.177769 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:00:32.191117 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c9e5-461d-4236-accd-6eeb86016551 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:00:32.249333 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '370ac9ef52ea4ad6930fdc193054ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff309e01cdfe4cb7b8cf92847353f141', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:00:32.250007 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:00:32.250227 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:00:32.250499 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] PATH_INFO: `/v3/projects/6efbe0854bd74519afa7bd60008521ac` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:00:32.251609 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efbe0854bd74519afa7bd60008521ac)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:00:32.253546 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:00:32.265056 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:32.352675 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efbe0854bd74519afa7bd60008521ac', 'request_id': 'req-e95a6202-bf42-48d1-afd2-70203445a89d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:32.358968 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efbe0854bd74519afa7bd60008521ac', 'request_id': 'req-e95a6202-bf42-48d1-afd2-70203445a89d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:32.413977 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efbe0854bd74519afa7bd60008521ac', 'request_id': 'req-e95a6202-bf42-48d1-afd2-70203445a89d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:32.425431 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] The token cache is being invalidate because project 6efbe0854bd74519afa7bd60008521ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 12:00:32.425652 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:32.426275 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e95a6202-bf42-48d1-afd2-70203445a89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 12:00:32.427770 dv-cinder-856460-2-smb devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1475/2952] 10.222.0.64 () {58 vars in 1233 bytes} [Fri Sep 9 12:00:32 2022] DELETE /identity/v3/projects/6efbe0854bd74519afa7bd60008521ac => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 12:00:41.881281 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:42.422324 dv-cinder-856460-2-smb devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:04:02.807931 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 12:04:02.809375 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:04:02.952122 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea013b5-9980-4196-b9c2-789a30590965 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 12:04:03.011444 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c4b86c13494f3fb1ff2957a2cbdf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c877ca414404c64b20ba9b6cbdd1aae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 12:04:03.012041 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 12:04:03.012321 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 12:04:03.012593 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 12:04:03.014352 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 12:04:03.026233 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 12:04:03.027887 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc508-23f0-48ad-8d59-6f9c5240f60a service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 12:04:03.037797 dv-cinder-856460-2-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1478/2953] 10.222.0.64 () {60 vars in 1365 bytes} [Fri Sep 9 12:04:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 12:04:13.033479 dv-cinder-856460-2-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}